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ABSTRACT 


We  consider  a  model  of  an  integrated  voice  and  data  network.  This 
model,  which  lends  itself  to  analytic  and  algorithmic  solution,  is  formu¬ 
lated  as  a  convex  optimization  problem.  The  objective  function  comprises 
two  types  of  functions:  the  congestion  cost  functions  and  the  rate  limi¬ 
tation  functions.  The  congestion  cost  functions  act  to  limit  the  average 
traffic  entering  into  the  network  to  values  that  would  not  cause  network 
congestion.  The  rate  limitation  functions  ensure  that  all  conversations 
are  fairly  treated.  The  model  can  be  generalized  to  solve  problems  of 
networks  which  handle  n  types  of  traffic  that  have  different  levels  of 
delay  sensitivity,  where  n  ^  2. 

A  joint  flow  control  and  routing  algorithm  is  constructed  which 
uses  short  term  average  information  on  the  network  utilization  to  set 
the  voice  packet  lengths  and  data  input  rates,  and  to  determine  the 
routes  for  each  conversation.  The  voice  packet  lengths  and  data  input 
rates  are  set  in  such  a  way  as  to  achieve  an  optimal  tradeoff  between 
each  user's  satisfaction  and  the  cost  of  network  congestion.  Additional 
protocols  are  specified  for  dealing  with  such  issues  as  congestion  avoidance 
and  control,  and  for  implementing  flow  control  on  a  more  dynamic  basis 
than  the  quasi-static  joint  flow  control  and  routing  algorithm  can  handle. 
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CHAPTER  I 


INTRODUCTION 


1.1  Motivation  For  The  Integrated  Network 

The  development  of  the  integrated  voice  and  data  network  concept 
has  resulted  from  a  combination  of  several  factors  including  the  following 

(a)  the  low  utilization  of  netv^fork  resources  when  voice,  data, 
fascimile,  etc.  are  transmitted  on  separate  communications  networks  in 
which  traditional  switching  techniques  are  used; 

(b)  the  success  of  such  data  communications  networks  as  the  Telenet 
[33],  the  Tymnet  [30],  the  French  Transpac  [10],  and  the  Canadian  Datapac 
C7]; 

(c)  the  recent  technological  advances  in  speech  processing,  parti¬ 
cularly  speech  digitization. 

In  a  telephone  conversation  a  speaker  alternates  randomly  between  the 
speaking  {or  talkspurt)  mode  and  the  listening  (or  silence)  mode. 
Measurement  studies  have  shown  that  in  a  typical  telephone  conversation 
a  speaker  uses  the  channel  only  35-40%  of  the  time  duration  of  the  con¬ 
versation  [4].  This  then  means  that  dedicating  a  channel  to  a  pair 
of  speakers  throughout  the  duration  of  their  conversation  is  a  waste  of 
the  network  resources. 

Many  techniques  have  been  proposed  to  minimize  this  waste.  These 
techniques  attempt  to  compress  n  voice  conversations  onto  m  channels, 
where  n  >  m.  The  earliest  of  these  techniques  is  the  Bell  System  "Time 


Assignment  Speech  Interpolation"  (TASI)  in  which  a  channel  is  allocated 
to  a  subscriber  only  when  the  appropriate  hardware  detects  that  he  is 
actively  speaking  [4].  Once  he  accesses  the  channel  the  speaker  uses 
it  without  interruption  for  the  duration  of  his  talkspurt.  During 
periods  of  silence  he  relinquishes  the  channel,  and  it  becomes  available 
to  other  speakers.  Any  talkspurt  that  is  generated  when  all  channels 
are  busy  is  "frozen  out"  and  will  have  to  wait  on  a  first-come  first- 
served  basis  for  an  available  channel.  This  freeze-out  results  in  the 
clipping  and  loss  of  the  initial  part  of  the  talkspurt.  It  is  even 
possible  to  lose  an  entire  talkspurt  if  the  waiting  time  is  longer  than 
the  spurt  duration  [30].  For  a  satisfactory  speech  quality  the  fraction 
of  the  lost  speech  should  be  less  than  0.5%.  The  ratio  of  the  number 
of  subscribers  supported  by  the  TASI  system  to  the  number  of  channels 
required  to  maintain  an  acceptable  fraction  of  lost  speech  is  called 
the  "TASI  Advantage".  If  p  is  the  fraction  of  time  that  a  typical 
speaker  is  in  talkspurt,  the  maximum  potential  TASI  advantage  is  1/p. 
Since  p  <  0.5,  this  advantage  is  greater  than  2,  However,  at  least 
40  channels  and  80  speakers  are  required  to  achieve  this  TASI  advantage 
[4].  For  a  smaller  number  of  channels,  attempts  to  achieve  a  TASI  advan- 
* tage  close  to  1/p  will  result  in  unacceptably  high  lost  fractions  [32]. 
The  TASI  system  described  above  is  oriented  toward  analog  speech  trans¬ 
mission.  Digital  variations  of  TASI  that  are  transmitted  in  the  PCM 
form  have  also  been  implemented.  These  include  Digital  Speech  Inter¬ 
polation  (DSI)  [5],  and  Speech  Predictive  Encoding  (SPEC)  [28]. 

Speech  is  bursty  in  nature,  and  this  accounts  for  the  low  utilizati 
of  the  transmission  resources  in  a  voice  communications  network  in  which 
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the  traditional  frequency  division  multiplex  (FDM)  or  time  division 
multiplex  (TDM)  is  used.  The  purpose  of  the  TASI  schemes  is  to  achieve 
a  better  utilization  of  the  network  resources  by  smoothing  out  the 
voice  flow.  Data  are  also  bursty  in  nature.  An  effort  to  smooth  out 
data  flow  in  a  network  has  led  to  the  concept  of  statistical  multiplexing 
[8]  or  store- and- forward  networks  [1].  Unlike  the  TDM  system  traditionally 
used  for  data  transmission,  no  slots  are  dedicated  to  any  data  source. 
Instead  messages  are  merged  into  a  buffer  at  each  network  node  and  the 
bits  are  transmitted  at  a  synchronous  rate.  The  messages  work  their 
way  through  the  network  to  their  destinations .queueing  at  each  node  where 
they  are  statistically  multiplexed.  The  messages  may  remain  in  complete 
form  (message  switching)  or  be  split  into  shorter  blocks  called  packets 
(packet  switching)  [1].  Whether  statistical  multiplexing  exists  in  the 
message-switched  or  packet-switched  form,  each  unit  carries  a  header 
which  specifies  among  other  things  the  source  and  destination  addresses 
of  that  unit.  There  is  basically  little  difference  between  packet 
switching  and  message  switching.  We  shall  use  the  term  packet  switching 
hereafter  for  both  techniques. 

That  speech  is  bursty  in  nature  makes  it  a  good  candidate  for 
statistical  multiplexing.  This  has  been  further  made  possible  by  the 
recent  advances  in  speech  processing  which  have  led  to  the  packetization 
of  speech.  This  means  that  packets  of  speech,  which  are  generated  only 
when  a  speaker  is  in  talkspurt,  could  be  stored  temporarily  at  each 
node  in  wait  for  free  channels.  Thus  there  would  be  no  loss  of  any  part 
of  the  speech  as  is  often  the  case  in  the  conventional  TASI  system. 

And  the  fact  that  speech  and  data  can  be  packetized  raises  the  possibility 


of  using  the  same  network  to  transmit  them.  One  then  hopes  that  such 
an  integration  of  speech  and  data  onto  the  same  network  would  lead  to 
better  utilization  of  the  network  resources  [17,18]. 

1 .2  Problems  With  Integration 

The  integration  of  voice  and  data  traffics  onto  one  network 
generates  new  communications  problems.  These  problems  include  the  choice 
of  an  appropriate  switching  technique,  and  how  to  control  the  network 
flow  in  order  to  meet  the  different  demands  made  on  the  network  by  voice 
and  data  conversations. 

Three  switching  strategies  have  been  proposed  for  use  in  the 
integrated  network  [17].  These  are: 

(a)  Circuit  Switching 

(b)  Packet  Switching 

(c)  Hybrid  Switching. 

In  circuit  switching,  an  end-to-end  connection  is  established  for  a 
pair  of  voice  or  data  users  before  they  commence  their  conversation. 

The  channel  is  dedicated  to  them  throughout  the  duration  of  the  conversa¬ 
tion.  The  channel  utilization  may  be  improved  by  using  the  TASI  system. 
In  packet  switching,  both  voice  and  data  conversations  are  digitized 
and  segmented  into  packets  and  routed  through  the  network  in  a  store-and- 
forward  manner  [1,21].  That  is,  each  packet  travelling  from  source  node 
i  to  destination  node  j  is  "stored"  in  queue  at  an  intermediate 
node  k  while  awaiting  transmission.  It  is  sent  "forward"  to  a  selected 
adjacent  node  I  on  the  route  to  node  j  when  link  (k,)l)  is  free.  The 
selection  of  node  l  is  made  by  some  well-defined  decision  called  the 


-5- 


routing  algorithm.  The  process  of  storing  and  forwarding  is  repeated 
until  the  packet  reaches  its  destination.  Packets  of  the  same  con¬ 
versation  usually  follow  the  same  path.  However,  they  may  follow 
different  paths,  possibly  arriving  at  the  destination  out  of  order. 

In  this  case  they  would  have  to  be  reassembled  in  their  right  order 
before  being  delivered  to  the  ultimate  user.  Packet  switching  thus 
avoids  dedicating  the  network  facilities  to  users  during  silent  periods 
since  no  packets  are  generated  then.  In  hybrid  switching,  both  circuit- 
switched  and  packet-switched  traffics  exist  concurrently  on  the  same 
channel.  Each  channel  is  partitioned  into  two  subchannels;  a  circuit- 
switched  subchannel  and  a  packet-switched  subchannel.  Voice 
traffic  uses  the  circuit-switched  subchannel  while  data  traffic  uses 
the  packet-switched  subchannel.  To  increase  the  channel  utilization 
a  "movable  boundary"  feature  can  be  incorporated,  which  permits  the 
data  packets  to  use  any  residual  circuit-switched  capacity  that  may 
be  momentarily  available  due  to  voice  traffic  variations  [9]. 

A  well-designed  communications  network  ensures  that  the  traffic 
it  handles  does  not  exceed  the  capacity  of  the  network  devices  in  order 
that  congestion  may  not  build  up  and  reduce  the  throughput  of  the 
network.  In  the  extreme  case  congestion  may  lead  to  a  deadlock  in 
which  case  communication  becomes  impossible.  The  term  flow  control  is 
used  to  describe  any  mechanism  that  ensures  that  the  traffic  entering 
into  the  network  is  maintained  within  limits  compatible  with  the  capacity 
of  the  network  devices.  A  flow  control  protocol  should  perform  the 
following  functions  [16]: 


(a)  It  should  prevent  throughput  degradation  and  loss  of  efficiency 


due  to  overload. 

(b)  It  should  prevent  deadlock. 

(c)  It  should  ensure  a  fair  allocation  of  the  network  resources 
among  competing  users. 

Cd)  It  should  ensure  that  the  rate  at  which  the  network  accepts 
data  is  matched  to  the  rate  at  which  it  can  transmit  them. 

Voice  and  data  traffics  make  different  and  conflicting  demands 
on  the  network:  They  show  different  tolerances  to  delay  and  errors. 

Voice  conversations  require  continuous  and  almost  real-time  delivery; 
they  are  very  sensitive  to  delay.  Data  conversations,  on  the  other 
hand,  are  generally  intolerant  of  errors  but  less  sensitive  to  delay. 

Data  conversations  need  to  be  very  reliably  delivered  to  their  ultimate 
users.  A  flow  control  protocol  that  is  to  be  applied  to  an  integrated 
voice  and  data  network  must,  therefore,  perform  two  additional 
important  functions,  namely: 

(a)  It  should  ensure  that  a  voice  conversation  is  transmitted 
with  essentially  constant  delay  while  trading  the  speech  quality  in 
response  to  nework  fluctuations. 

(b)  It  should  ensure  that  data  conversations  are  transmitted 
with  maximum  reliability  (that  is,  no  errors  or  lost  information)  with 
communications  delay  as  a  secondary  considerations. 

1 .3  Summary  of  Previous  Work 

The  concept  of  integrated  voice  and  data  communications  networks 
has  generated  much  interest.  It  has  been  motivated  by  the  need  to  exploit 
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recent  technological  advances  to  achieve  economies  of  scale:  sharing 
network  resources  more  efficiently  thereby  reducing  the  cost  per  user. 
Unfortunately  much  of  the  work  done  in  this  area  so  far  exists  as  mere 
heuristics  that  depend  on  simulation  for  evaluation. 

Coviello  and  Vena  [9]  propose  a  type  of  hybrid-switched  network 
called  the  slotted  envelope  network  (SENET)  which  provides  some  degree 
of  flexibility  for  a  varying  mix  of  traffic.  It  is  a  framed  TDM  scheme 
in  which  frames  are  divided  into  (V+D)  slots.  V  slots  are  allocated 
to  voice  conversations  on  a  circuit-switched  basis,  and  D  slots  are 
allocated  to  data  conversations  on  a  packet- switched  basis.  Voice  calls 
are  blocked  when  all  the  V  slots  reserved  for  voice  conversations  are 
busy.  A  voice  conversation  uses  its  slot  throughout  the  duration  of  the 
conversation.  In  order  to  increase  the  channel  utilization,  a  movable 
boundary  scheme  is  used  whereby  data  traffic  could  use  any  voice  slots 
that  may  be  momentarily  free  due  to  variations  in  the  number  of  active 
voice  conversations.  Forgie  and  Nemeth  [11]  consider  a  network  concept 
called  the  packetized  virtual  circuit  (PVC)  which  combines  selected 
features  from  the  packet  and  circuit  switching  technologies.  The  PVC 
technique  is  more  or  less  a  packet  switching  technique  in  which  messages 
are  packetized  and  travel  along  virtual  connections  to  their  destinations. 
The  authors  also  suggest  some  ways  to  deal  with  congestion  in  the  net¬ 
work,  including  discarding  some  voice  packets  when  queues  become  excessive. 
Bially  et  al.  [3]  propose  a  packet-switched  network  in  which  a  speech 
digitization  concept  called  "embedded  coding"  enables  the  network  to 
respond  dynamically  to  the  loading  conditions.  Here  speech  is  encoded 
into  different  packets  of  different  orders  of  importance.  If  all  the 


packets  are  delivered  to  the  sink,  the  result  would  be  a  high  quality 
speech.  When  the  network  loading  becomes  high  the  less  important  packets 
may  be  discarded.  The  delivered  packets  still  produce  usable  but  lower 
quality  speech.  Gitman  and  Frank  [17]  present  an  elaborate  economic 
analysis  of  the  integrated  voice  and  data  networks.  They  conclude,  on 
the  basis  of  a  number  of  assumptions,  that  even  when  no  optimization 
is  performed  in  selecting  the  voice  packet  length,  packet  switching  is 
still  superior  to  all  other  switching  techniques. 

1.4  Synopsis  of  the  Thesis 

The  hybrid-switched  network  is  basically  two  distinct  networks  in 
one,  if  the  movable  boundary  feature  is  not  incorporated.  Since  operational 
circuit-switched  and  packet-switched  networks  exist,  designing  a  pure 
hybrid-switched  integrated  voice  and  data  network  (i.e.  one  without 
movable  boundaries)  presents  no  new  challenges.  When  the  movable  boundary 
feature  is  incorporated,  the  difference  between  the  hybrid-switched  and 
the  packet-switched  network  becomes  a  matter  of  semantics  rather  than 
technology  as  the  operation  of  the  two  techniques  are  almost  identical, 
but  not  quite  anyway. 

We  design  a  packet-switched  integrated  network  that  achieves  a 
better  resource  allocation  than  the  pure  hybrid-switched  network.  We 
chart  a  new  course  by  formulating  the  integrated  network  problem  in  a 
way  that  lends  itself  to  an  analytic  and  algorithmic  solution.  Voice 
packets  have  a  non- preemptive  priority  over  data  packets.  The  reason 
for  practising  a  non- preemptive  priority  includes  the  fact  that  when  a 
data  packet  receiving  service  is  preempted  by  an  arriving  voice  packet. 


-9- 


the  part  of  the  data  packet  which  had  already  been  transmitted  before 
preemption  might  appear  as  errors  in  the  network.  We  could  avoid  this 
confusion  by  practising  a  non- preemptive  priority.  Also  it  does  not 
make  sense  to  use  network  resources  to  transmit  data  bits  that  would 
later  be  discarded. 

As  the  title  of  this  thesis  suggests,  we  are  primarily  interested 
in  the  flow  control  and  routing  issues  of  the  integrated  network.  We 
shall,  however,  discuss  some  protocols  for  congestion  avoidance  and 
control,  and  for  admitting  new  conversations  into  the  network. 

The  remainder  of  the  thesis  is  organized  as  follows.  In  Chapter  II 
we  present  the  formulation  of  the  network  model  and  the  problem  statement. 
In  Chapter  III  we  give  a  solution  to  the  problem  of  Chapter  II.  We  also 
formulate  a  joint  flow  control  and  routing  algorithm.  In  Chapter  IV  we 
consider  protocols  for  performing  miscellaneous  functions,  including 
congestion  avoidance  and  control,  and  the  admission  of  new  conversations 
into  the  network.  In  chapter  V  we  discuss  how  the  model  can  be  generalized 
for  a  multi-traffic  network  that  carries  traffic  with  different 
levels  of  delay  sensitivity.  In  Appendices  A  and  B  we  give  proofs  of 
theorems. 


CHAPTER  II 


MODEL  FORMULATION  AND  PROBLEM  STATEMENT 


2.1 .  Introduction 

In  [12]  Gallager  formulates  a  quasi-static  routing  strategy  for  a 
data  communication  network.  He  considers  a  network  with  slowly  varying 
average  input  rate  for  each  data  conversation,  and  develops  an  algorithm 
for  finding  minimal  delay  routing  using  distributed  computation.  Golestaani 
[19]  extends  Gallager's  work  by  considering  a  network  with  controllable 
input  rates.  These  rates  are  adjusted  periodically  on  the  basis  of  the 
information  on  the  network  utilization.  Also  these  rates  are  controlled 
in  a  manner  that  ensures  that  all  users  are  fairly  treated.  The  algorithm 
developed  in  [19]  implements  this  fairness  by  attempting  to  establish  an 
optimal  tradeoff  between  each  user's  satisfaction  and  the  network  loading 
condition.  A  user's  satisfaction  is  related  to  the  rate  at  which  he  is 
permitted  to  transmit:  the  closer  the  permitted  rate  is  to  his  desired 
rate,  the  more  satisfied  the  user  is. 

The  work  done  here  is  a  further  generalization  of  the  work  of 
Gallager  [12],  with  applications  to  the  integrated  voice  and  data  network. 

As  in  [19]  we  consider  an  integrated  network  with  controllable  voice 
and  data  input  rates.  The  voice  input  rate  is  controlled  by  adjusting 
the  voice  packet  lengths.  The  length  of  the  voice  packets  determines  the 
quality  of  the  voice  conversation:  the  longer  the  packets,  the  higher  is 
the  quality  of  the  conversation.  The  voice  packet  lengths  and  the  data 
input  rates  are  also  controlled  in  a  manner  that  ensures  that  all  users 


are  fairly  treated.  We  effect  this  fairness  by  developing  an  algorithm 
that  attempts  to  establish  an  optimal  tradeoff  between  the  network 
conditions  and  all  users'  satisfaction.  For  voice  conversations,  the 
longer  the  packets  (and  hence  the  higher  the  speech  quality)  the  more 
satisfied  the  user  is.  And  for  data  conversations,  the  closer  a  user's 
allowed  rate  is  to  his  desired  rate,  the  more  satisfied  he  is.  We  assume 
that  a  voice  digitizer  that  can  set  the  voice  packets  to  any  desired  lengths 
can  be  found.  We  do  not  concern  ourselves  with  what  happens  to  the 
speech  at  the  receiver  if  the  voice  packet  length  is  continuously  varied. 
This  is  an  aspect  of  signal  processing  and  has  not  yet  been  resolved; 
it  is  a  topic  for  future  research. 

The  work  done  here  is  not  the  first  to  consider  a  scheme  where 
voice  packet  lengths  are  varied  in  response  to  network  conditions.  The 
work  of  Bially  et  al .[3]  is  similar  to  ours.  The  way  flow  control  is 
effected  in  [3]  is  equivalent  to  varying  the  voice  packet  length  inside 
the  network,  and  their  scheme  is  more  dynamic  than  ours.  In  this  thesis 
we  apply  flow  control  at  the  input  to  the  network  by  making  changes  in 
voice  packet  lengths  before  sending  the  packets  into  the  network.  This 
would  then  reduce  the  need  to  drop  any  segments  of  these  packets  in  the 
network  as  is  equivalently  done  in  [3].  We  shall  discuss  the  similarity 
betweeen  the  two  models  more  in  Chapter  IV. 

2.2  The  Model 
2.2.1  Definitions 

Consider  a  store-and- forward  network  with  N  nodes  represented  by 
i  »  1,2,...,N.  A  link  that  goes  from  node  k  to  node  I  is  represented 
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by  the  symbol  (k.i,).  We  assume  that  link  (k.Jl)  is  a  directed  link  and 
is  thus  different  from  link  (Ji,k).  Since  most  voice  and  data  links  in 
use  are  full  duplex,  we  assume  that  if  link  (k,Ji)  exists  then  link  (A,k) 
also  exists.  Let 


=  the  expected  voice  traffic  on  link  Ci»k)»  in 
bits/second,  destined  for  node  j 
=  the  expected  data  traffic  on  link  (,i,k),  in 
bits/second,  destined  for  node  j 
=  the  expected  length  of  voice  packets,  in  bits, 
belonging  to  conversations  which  enter  the  net¬ 
work  at  node  i  and  are  destined  for  node  j 
*  the  expected  data  input  rate  at  node  i  ,  in 
bits/second,  of  conversations  destined  for  node  j 
=  the  rate  at  which  voice  packets  are  emitted  by 
the  voice  digitizer  during  a  talkspurt 


n 


s  the  aggregate  voice  traffic,  in  bits/second,  on 
link  (i,k) 

N 

=  Z  ft  U) 

j=l 

=  the  aggregate  data  traffic,  in  bits/second, 
on  link  (i,k) 

3  ,  is  the  total  traffic  on  link  (i,k) 
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C^.j^  =  the  capacity  of  link  (i,k)  in  bits/second 

0(i)  *  the  set  of  nodes  with  links  going  out  from  node  i 

I(.i)  =  the  set  of  nodes  with  links  going  into  node  i 

m--  =  the  number  of  data  conversations  entering  the  network 

*  J 

at  node  i  and  destined  for  node  j 
n..  =  the  number  of  "off-hook"  speakers  with  voice  conversations 

*  w 

entering  the  network  at  node  i  and  destined  for  node  j 
n..  is  made  up  of  two  parts: 

*  w 

nl.  =  the  number  of  n..  in  talks purt 
1  J  1  J 

nf.  =  the  number  of  n..  in  silence. 

•  J 

When  a  speaker  is  off-hook  (i.e.  in  the  conversational  mode)  he 
alternates  randomly  between  the  talkspurt  and  the  silence  modes.  For 
a  large  value  of  n..,  the  number  of  speakers  in  talkspurt  can  be  modelled 

’  J 

by  a  Poisson  arrival  process  with  rate  9.  For  ease  of  analysis  we 
assume  that  the  holding  times  of  talkspurts  arS  exponentially  distributed 
with  mean  Then  the  speaker  activity  for  the  (i,j)  off-hook  conver¬ 

sations  can  be  modelled  by  the  Markov  chain  shown  in  Fig.  2.1. 


Figure  2.1  Speaker  Activity  Model  for  (i,j)  Conversations 


Thus  the  activity  of  each  off-hook  speaker  can  be  modelled  by  the  two- 
state  Markov  chain  shown  in  Fig.  2,2- 


e 


TsTalkspurt  State 
S  HSilence  State 


Figure  2.2  A  Markov  Chain  Model  of  A  Speaker 


The  steady-state  probability  that  the  speaker  is  in  talkspurt  is: 


'r  •  rH  (2-1) 

Therefore,  if  there  are  n. .  off-hook  speakers,  the  steady-state 

*  V 

probability  that  k  of  them  are  in  talkspurt  is: 


Pk 


k 

Y 


(1 


(2.2) 


One  problem  in  the  modelling  of  a  voice  network  is  that  for  any  given 
number  of  off-hook  speakers  the  number  of  speakers  in  talkspurt  changes 
too  fast  to  be  tracked  by  any  reasonable  algorithm  that  makes  use  of 
global  information.  We  are  then  left  with  the  choice  of  estimating  nT., 

*  J 

given  n^j.  In  this  work  we  initially  estimate  nlj  by  the  mean  value  of  k; 
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2.2.2  Voice  Packet  Delay  Variations 

Traditional  circuit  switching  systems  exhibit  fixed  delay  to 
voice  traffic.  Packet  switching  systems,  on  the  other  hand,  exhibit 
variable  delay  due  to  the  possible  queueing  of  the  voice  packets  at  the 
different  nodes  on  the  route  from  the  source  to  the  destination.  It  is 
assumed  that  when  a  speaker  is  in  talkspurt  the  voice  digitizer  emits 
voice  packets  at  a  constant  rate  of  8  packets  per  second  [3],  These 
packets  experience  different  queueing  delays  along  their  route.  If  each 
packet  is  delivered  to  the  ultimate  user  (or  sink)  as  soon  as  it  arrives 
at  the  destination  node,  the  received  message  would  contain  many  uneven 
and  annoying  gaps.  Therefore,  it  is  necessary  that  we  install  a  smoothing 
buffer  at  the  destination  node,  temporarily  store  the  arriving  voice 
packets,  and  finally  release  them  to  the  sink  at  the  same  rate,  8 
packets/second,  at  which  the  voice  digitizer  sent  them  into  the  network. 
In  Chapter  IV  we  shall  consider  the  case  where  the  rate  at  which  the 
packets  are  released  to  the  sink  is  different  from  8. 

A  schematic  diagram  of  what  happens  to  the  voice  packets  as  they 

travel  along  the  route  from  source  node  i  to  destination  node  j  is 

shown  in  Fig.  2.3.  Figure  2.4  is  a  diagram  of  the  possible  path  delays 

of  five  packets  of  a  conversation.  The  first  packet  is  transmitted  at 

time  zero;  the  second  packet  at  time  1/8;  and  in  general,  the  k^^  packet 

k-1 

is  transmitted  at  time  k  ^  1.  There  are  three  links  on  the  path. 


From  other  nodes 


From  the  diagram  we  observe  that  the  first  packet  suffers  a  delay  d^^, 
since  it  arrives  at  time  d^.  This  packet  is  not  delivered  immediately 
to  the  sink  but  is  held  back  in  the  buffer  for  some  time  -  d„,  and 
delivered  at  time  The  reason  for  this  action  will  be  clear  shortly. 

The  second  packet  arrives  at  time  d^;  it  is  held  back  in  the  buffer  and 
released  at  time  +  1/^.  The  third  packet  arrives  at  time 
d2  =  +  2/6.  just  in  time  to  be  delivered  to  the  sink.  The  fourth 

packet  arrives  later  than  it  is  required  to  be  delivered  to  the  sink 
and  so  is  discarded.  A  protocol  could  be  formulated  for  generating 
fictitious  packets  which  are  to  be  released  to  the  sink  when  the  actual 
packets  arrive  late.  However,  this  is  a  signal  processing  function  which 

f  h 

we  will  not  be  concerned  with  here.  In  general,  if  the  k  packet 

k-1 

arrives  earlier  than  ,  k  >  1,  it  is  stored  in  the  buffer 

k-1 

and  released  to  the  sink  at  time  t„  +  .  If  it  arrives  later  than 

0  6 

this  time,  it  is  thrown  away. 

The  reason  for  imparting  the  extra  delay  on  the  first  packet  is 
now  obvious:  to  help  reduce  the  likelihood  of  discarding  other  packets 
due  to  their  late  arrival.  Obviously  choosing  the  extra  delay  -  d^ 
to  be  very  large  ensures  that,  with  a  probability  close  to  one,  all 
packets  arrive  in  time  to  be  delivered  to  the  sink.  However,  this  is 
not  the  solution  we  seek.  We  have  noted  that  voice  conversations  require 
almost  real-time  delivery;  therefore,  the  recommended  choice  of  the  extra 
delay  is  <  1/6. 

One  of  our  objectives  in  the  above  scheme  would  be  to  reduce  the 
path  delay  of  each  voice  packet.  This  would  in  turn  reduce  the  likelihood 
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of  the  packet  being  discarded.  Another  objective  would  be  to  increase 
the  qualit-  ‘f  each  voice  conversation.  A  realization  of  these  objectives 
resides  in  making  tradeoffs  between  speech  quality  and  delay.  Short 
packets  would  travel  faster  than  long  packets  for  two  reasons.  First, 
there  is  less  transmission  delay  per  packet  on  each  link.  Secondly, 
short  packets  generate  smaller  traffic  than  long  packets,  and  so  there 
is  reduction  in  congestion.  Thus  the  use  of  short  packets  would  solve 
the  delay  problem-.  However,  short  packets  imply  poorer  quality  speech. 
Therefore,  we  need  to  use  long  packets  in  order  to  generate  higher 
quality  speech;  but  there  is  the  attendant  possibility  of  incurring 
larger  packet  delay.  Any  attempt  to  gain  in  quality,  therefore,  results 
in  poorer  delay  performance;  and  any  attempt  to  improve  the  delay  performance 
degrades  the  quality.  We  need  then  to  specify  what  would  be  the  point  of 
optimal  tradeoff  between  quality  and  delay  such  that  once  we  attain  it, 
we  would  not  be  tempted  to  improve  the  quality  or  the  delay  performance 
any  further.  This  suggests  that  we  formulate  an  optimization  problem 
the  solution  of  which  would  generate  the  optimal  packet  lengths  (and 
hence  quality)  and  the  optimal  delay.  Our  task  then  boils  down  to 
choosing  the  appropriate  objective  function  for  the  problem.  Since  we 
are  dealing  with  an  integrated  voice  and  data  network,  we  must  ensure 
that  the  solution  to  the  problem  we  shall  formulate  also  provides  the 
optimal  data  input  rates  and  the  optimal  data  packet  delay.  In  the 
subsequent  subsections  we  discuss  the  different  aspects  of  the  problem, 
and  find  appropriate  cost  functions  that  will  constitute  the  objective 
function. 
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2.2.3  Cost  of  Link  Congestion 

Let  =  the  delay  experienced  by  the  packet  of  a  talkspurt  on 

link  (k,Ji)  including  procesing  and  queueing  delays  at  node  k 

R  =  the  route  of  the  voice  conversation 

Then  d*^  *  ^  d|^^  ,  is  the  path  delay  of  the  n^^  packet  of  the 

(k,il)eR 

talkspurt. 

In  the  discussion  above  the  delay  experienced  by  the  first  packet 
of  a  talkspurt,  d\  is  crucial  in  determining  whether  or  not  a  subsequent 
packet  is  discarded.  If  the  first  packet  experiences  little  delay  while 
other  packets  experience  larger  delays,  then  many  of  these  packets 
would  be  discarded.  On  the  other  hand,  if  the  first  packet  experiences 
a  large  delay  while  other  packets  experience  less  delay,  then  not  many 

^  u 

of  these  packets  would  be  discarded.  Thus  the  probability  that  the  n^ 
packet  of  a  talkspurt  would  be  discarded  depends  not  only  on  d"^  but  also 
on  d\  This  dependence  on  d^  is  not  a  very  desirable  feature.  In  order 
to  reduce  this  dependence  (it  cannot  be  totally  eliminated!),  we  will 
attempt  to  make  all  packets  of  the  same  talkspurt  experience  similar 
delays  on  each  link  on  their  path.  This  would  then  translate  to 
their  experiencing  similar  path  delays,  and  hence  reducing  the  chances 
of  their  being  discarded. 

We  hope  to  realize  the  above  objective  as  follows.  We  consider  a 
cost  to  be  associated  with  the  link  delay  of  each  voice  packet.  Similarly, 
we  consider  a  cost  to  be  associated  with  the  link  delay  of  each  data  packet. 
Since  the  delay  requirements  of  voice  packets  are  more  stringent  than 


those  of  data  packets,  we  grant  the  voice  packets  a  non-preempti ve 
priority  over  the  data  packets.  Packets  wait  on  a  first-come  first- 
served  basis  within  their  priorities.  We  assume  that  the  queue  at  each 
output  link  can  be  modelled  by  an  M/G/1  queue  with  priorities  [22], 
Consider  a  tagged  packet  that  arrives  at  a  node  for  service. 

Let 

Xy  =  the  Poisson  rate  at  which  voice  packets  arrive  at  the 
output  queue  of  the  node,  in  packets/second 

Xj  =  the  Poisson  rate  at  which  data  packets  arrive  at  the 
queue,  in  packets/second 

n^  =  the  number  of  voice  packets  already  in  queue  when  the 
tagged  packet  arrived 

n^  =  the  number  of  data  packets  already  in  queue  when  the 
tagged  packet  arrived 

I 

n^  =  the  number  of  voice  packets  which  arrive  while  the  tagged 
packet  is  in  queue. 

Note  that  if  the  tagged  packet  is  a  voice  packet  these  n^  packets  have 
no  effect  on  its  waiting  time. 

=  the  remaining  time  to  complete  the  service  of  the  packet 
in  service  when  the  tagged  packet  arrived 
=  the  time  to  service  all  the  n^  voice  packets 

•  I 

=  the  time  to  service  all  the  n^  voice  packets 

Tg  =  the  time  to  service  all  the  n^  data  packets. 


Then  if  the  tagged  packet  is  a  voice  packet,  its  waiting  time  is; 


Taking  expectations  we  obtain 

+  Wi  (2.4) 

where  W^.  =  E(T.).  If  the  time  to  service  one  voice  packet  is  then 

Wi  =  ECn^)  E(Ty)  =  E(n^)  . 


By  Little's  formula  [24],  E{nj)  =  W^.  We  cannot  apply  Little's  formula 
directly  to  E(ny),  but  we  can  establish  its  value  by  the  following  argument. 
Since  we  know  that  a  data  packet  waits  for  an  average  time  and  that  voice 
packets  arrive  at  an  average  rate  X^  ,  clearly  the  average  number  of 


-22- 


voice  packets  which  arrive  over  the  time  Interval  Is  ECn^)  = 
A  more  rigor:  .  derivation  of  this  formula  can  be  found  in  [22J, 
Therefore,  from  C2.6) 


^d  *  ^  ^v  ^v  ^v  ^  ^v  ^v  ^  ^d  '"^d  ^d 


or  _  Wr  VvA_  _  ^r^  ^v  ^ 

a  "  T  -  -  Pj  "  1  -  P 

A  _ 

where  =  X^  Is  the  link  data  utilization  factor 
A 

p  =  Pv  +  Pd  <  1,  Is  the  link  aggregate  utilization  factor. 

Substituting  for  we  obtain 


We  may  rewrite  (2.5)  and  (2.7)  as  follows: 

W.C  W.C 

U  s  — - _  =  — - 

V  C-D  C  C-F 

^v  V 


(2.8) 


where  =  the  link  voice  traffic, in  bits/second, 

F  *  the  aggregate  link  traffic.  In  bits/second, 

C  =  the  link  capacity.  In  bits/second. 

For  completeness,  the  expected  remaining  time  to  completion  of  service 
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of  the  packet  in  service  when  the  tagged  packet  arrived  is  given  by 

C22]: 

"r  "  f  i:\  t  (2.10) 

The  delay  of  a  voice  packet  at  a  link  (t,k)  is  made  up  of  the 
waiting  time  and  the  service  time  (including  queueing  and  processing 
delays  at  node  l) ,  The  latter  is  usually  independent  of  the  network 
status.  Hence  at  each  node  we  bother  only  about  the  waiting  time  at  the 
output  link.  From  (2.8)  we  observe  that  the  expected  waiting  time  of 
a  voice  packet  is  a  function  of  the  link  voice  traffic  F^.  This 
expected  waiting  time  is  also  affected  by  the  amount  of  time  the  voice 
packet  has  to  wait  for  a  data  packet  already  in  service  when  the  voice 
packet  arrived;  but  this  effect  is  rather  small.  Because  of  these 
facts  we  define  a  cost  function  as  follows:  B..j^(FY|^)  is  the 

cost  of  limiting  the  voice  traffic  on  link  (i,k)  to  F^j^.  For  mathematical 
tractability  we  assume  that  B^|^(Fy|^)  is  a  convex  increasing  and  twice 
differentiable  function  of  fYj^,  with  a  typical  plot  as  shown  in  Fig. 2. 5. 


The  reason  for  the  cutoff  at  is  the  following. 

From  (2.8)  we  observe  that  as  F^  approaches  C,  the  waiting  time  becomes 
large.  Since  voice  packet  delay  is  a  critical  issue,  we  limit  the  voice 
traffic  on  each  link  to  some  predetermined  fraction,  ,  of  the  link 
capacity.  This  flow  restriction,  coupled  with  the  fact  that  voice 
traffic  has  a  non-preemptive  priority  over  data  traffic,  would  enable 
the  voice  packets  to  experience  less  delay  than  would  be  the  case  if 
the  restriction  were  removed.  That  is,  if  we  hold  the  voice  traffic 
below  C^.|^,  the  link  delay  would  be  small. 

We  could  define  a  cost  function  for  the  data  traffic  in  a  similar 
manner.  However,  we  can  exploit  some  characteristics  of  voice  traffic  in 
defining  the  cost  function  for  the  data  traffic.  First,  observe  from  (2.9) 
that  the  expected  waiting  time  of  a  data  packet  at  the  output  link  is  a 
function  of  both  F^  and  F.  One  major  attraction  of  the  integrated  voice 
and  data  network  is  the  anticipated  possibility  of  exploiting  the  on-off 
characteristics  of  voice  traffic  to  transmit  more  data  when  voice  traffic 
is  low.  A  reasonable  cost  function  for  data  traffic  should,  therefore, 
recognize  this  fact:  when  F^i^  =  0  the  data  packets  should  be  able  to 
use  link  (i,k)  as  if  the  network  were  an  all -data  network.  Since  data 
packet  delay  requirements  are  not  as  stringent  as  those  for  voice  packets, 
we  would  permit  a  higher  cutoff  point  for  each  link  flow.  A  cutoff  is 
necessary  to  account  for  the  finite  buffer  spaces  available  at  the 
ojtput  links. 

That  data  packet  delay  is  more  tolerable  than  voice  packet  delay 
means  that  the  marginal  cost  to  a  link  of  a  voice  packet  should  be  at 
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least  as  great  as  that  of  a  data  packet.  That  is,  the  cost  of  congestion 
for  an  additional  voice  packet  is  greater  than  that  for  an  additional 
data  packet.  When  a  given  voice  packet  arrives  at  a  node,  it  holds  up 
the  service  of  all  data  packets  in  queue  on  its  arrival.  Its  delay  is 
only  affected  by  the  voice  packets  which  are  in  queue  on  its  arrival. 

Data  packets  affect  the  voice  packet's  delay  through  the  possibility 
that  a  data  packet  was  receiving  service  when  the  voice  packet  arrived. 

As  we  said  earlier,  this  effect  is  rather  small.  When  a  given  data 
packet  arrives  at  a  node,  its  delay  is  affected  not  only  by  all  the 
packets  (both  voice  and  data)  in  queue  on  its  arrival  but  also  by  all 
voice  packets  which  arrive  while  it  is  in  queue.  We  then  need  a  model 
that  recognizes  this  difference  in  the  marginal  costs  for  voice  and 
data  conversations. 

Now  consider  the  cost  function  defined  as  follows:  G^|^(F^I^)is 

the  cost  of  limiting  the  aggregate  traffic  on  link  (i,k)  to  F^.j^.  For 
reason  of  mathematical  tractability  we  assume  that  G^.|^(F^.|^)  is  a  convex 
increasing  and  twice  differentiable  function  of  F^.j^,  with  the  typical 


Let  the  composite  function  fVi^)  be  defined  as  follows; 


Plk>  “  5lk<4>  ^  =1k<Fik) 


C2-n) 


That  the  composite  function  captures  the  essence  of  our  design 
objectives  for  congestion  as  listed  above  can  be  seen  from  the  following 
analysis.  When  fVj^  *  0,  then  from  the  way  we  have  defined  we 

have  that  B^.|^(0)  =  0  and 

S(k(-fikiflk  =  °)  =  '5ik(f?k' 

Thus 

'>1k‘Fik*'»  '  ^ik(f?k) 

This  is  precisely  the  cost  function  defined  by  Golestaani  [19]  for  an 
all-data  network.  Also  the  derivatives 


3D 


ik 


’  Sfk  (flk>  "  Sk  (fik) 


=  =lk  <fik) 


[where  (fJ,^)  =  ^^ik  ,  etc.] 

are  the  marginal  costs  to  link  (i,k)  of  voice  and  data  conversations 
respectively.  As  can  be  seen  above, the  marginal  cost  of  voice  to  link 
(i,k)  is  greater  than  that  of  data,  as  we  hoped. 


In  sumnary  then,  our  argument  is  that  we  need  two  cost  functions 
that  relate  to  delay  (or  congestion)  in  the  integrated  network.  One  cost 
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function  deals  with  the  issue  of  ensuring  that  we  load  the  network  with 
voice  traffic  to  such  a  level  that  would  not  make  the  voice  packet  delay 
excessive.  The  other  cost  function  deals  with  the  mix  of  voice  and  data 
traffics.  This  latter  function  allows  us  to  exploit  the  on-off  character¬ 
istics  of  voice  traffic  to  transmit  more  data  when  voice  traffic  is  low. 

2.2.4  Voice  Quality  Limitation  Cost 

Having  considered  the  issue  of  congestion  in  the  network  we  now 
deal  with  the  issue  of  fairness  to  all  voice  conversations.  We  wish 
to  design  a  network  that  operates  as  follows.  When  a  voice  conversation 
is  established  the  network  is  bound  to  accept  all  packets  of  that  converse 
tion  as  long  as  the  speaker  is  off-hook.  However,  the  quality  of  that 
conversation  is  not  guaranteed  to  be  good  at  the  sink.  The  quality  of 
different  talkspurts  of  the  same  conversations  may  even  be  different, 
depending  on  the  status  of  the  network  when  a  talkspurt  is  generated. 

As  we  have  mentioned  earlier,  the  quality  of  any  voice  conversation  is 
related  to  the  length  of  the  packets  of  that  conversation:  the  longer  the 
packets,  the  higher  the  quality  of  the  conversation. 

In  order  to  effect  fairness  to  all  voice  conversations,  then,  we 
make  it  increasingly  costly  to  degrade  the  quality  of  any  conversation 
any  further  through  assigning  shorter  and  shorter  packets  to  that 
conversation.  Let  a  voice  conversation  that  enters  the  network  at 
node  i  and  is  destined  for  node  j  be  denoted  by  voice  conversation 
(i,j).  For  each  voice  conversation  (.i,j)  we  define  a  nominal  packet 
length  a..;  that  is,  the  maximum  length  we  can  assign  to  packets  of 

*  w 

conversation  (i,j)  is  a...  The  reasons  for  this  packet  length  limitation 

•  w 
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are  as  follows.  First,  above  a  certain  packet  length  there  is  no 
appreciable  Improvement  in  the  voice  quality.  Therefore,  it  would  not 
make  sense  to  assign  lengths  that  would  generate  more  traffic  without 
any  extra  gain  in  quality.  Secondly,  the  voice  digitizer  is  limited 
in  the  number  of  bits  it  can  generate  over  a  given  time  interval.  For 
each  voice  conversation  (i,j)  we  define  a  cost  function  as 

'  w  *  J 

follows:  V..(l..)  is  the  cost  of  restricting  the  packet  length  of  voice 

I  J  I  J 

conversation  (i,j)  to'  Jl...  For  mathematical  tractability  we  assume 

*  V 

that  is  a  convex  non-increasing  and  twice  differentiable  function 

of  1..  with  the  typical  plot  as  shown  in  Fig.  2.7.  For  rotational 
*  J 

convenience  we  assume  that  all  voice  conversations  (i,j)  have  the  same 
cost  function 


Figure  2.7  Quality  Limitation  Cost  of  A  Voice  Conversation  (i,j) 
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2.2.5  Data  Rate  Limitation  Cost 

For  data  conversations  we  let  the  allowable  input  rates  depend 

on  the  network  loading  conditions:  when  the  network  is  heavily  loaded 

we  make  the  input  rates  small,  and  when  the  network  is  lightly  loaded 

we  permit  higher  input  rates.  We  thus  assume  that  the  lengths  of  data 

packets  are  independent  of  the  network  control.  In  order  to  effect 

fairness  to  all  data  conversations  we  make  it  increasingly  costly  to 

cut  back  any  conversation  further  through  assigning  it  a  smaller  and 

smaller  input  rate.  In  this  regard  we  define  a  cost  function  E..(n..) 

T  J  1 J 

as  follows:  ^..(r. .)  is  the  cost  of  restricting  the  input  rate  of 

'  w  ^  w 

data  conversation  (i.j)  to  r  For  reason  of  mathematical  tractability 

'  v 

we  assume  that  it  is  a  convex  non- increasing  and  twice  differentiable 
function  of  r_  ,  with  the  typical  plot  as  shown  in  Fig.  2.8.  For 
simplicity  of  notation,  we  take  to  be  the  same  for  all  data 

conversations  (i,j).  r^.  is  some  desired  rate  at  which  data  conversation 

(i.j)  would  be  transmitted  if  we  did  not  exercise  any  control  over  it. 


2,3  The  Problem  Statement 

Our  model  formulation  is  now  complete.  The  objective  function 


of  our  problem  is 

a  sum  of  four  terms: 

(i) 

a-r(F^) 

= 

(ii) 

Gj(F) 

= 

(iii) 

VjCil) 

= 

(iv) 

ET(r) 

^  ^'j  ^ij^'"ij^ 

where  Yn.,  is,  as  we  stated  earlier,  our  estimate  of  nl.,  the  number 

I  J  »  J 

of  off-hook  speakers  in  talkspurt;  and  m..  is  the  number  of  data 

^  0 

conversations  (i,j).  We  can  then  formulate  the  problem  as  follows: 


Minimize  J 
subject  to 


+  G,r(F)  +  +  E-^Cr) 


k£0(i) 


^k^J)  - 


TT.  \  nil  ij  ij 

mel(i) 

1  <  i  ,0  <  N 


Z 

k£0(i) 


2  fji(j)  =  m.j  r.. 
UKi)  ^ 

1  1  Uj  1  N 


4(j)  >  0 


1  <  i ,j ,k  <  N 


(2.13] 

(2.14] 

(2.15] 


f?Jj)  iO 


i  f  j 


(2.16 
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Constraints  (2.14)  and  (.2,15)  are  the  so-called  continuity  (or  flow 
conservation)  equations.  They  state  that  the  total  traffic  coming  into 
node  i  and  destined  for  node  j  is  equal  to  the  total  traffic  going 
out  of  node  i  and  destined  for  node  j.  Constraint  (2,16)  states  that 
flows  are  non-negative.  In  the  next  chapter  we  present  a  solution  to 
this  problem  and  develop  a  joint  flow  control  and  routing  algorithm  that 
sets  the  voice  packet  lengths  t.  .  and  data  input  rates  r. .  to  values 

I  J  I  J 

compatible  with  the  network  status,  and  for  routing  the  voice  and  data 
traffics. 


CHAPTER  III 


SOLUTION  TO  THE  PROBLEM 

3.1  Introduction 

In  Chapter  II  we  formulated  a  model  of  the  integrated  voice  and 
data  network  as  a  convex  optimization  problem.  In  this  chapter  we 
present  a  solution  to  this  problem.  We  construct  a  joint  flow  control 
and  routing  algorithm  that  sets  the  voice  packet  lengths  and  the  data 
input  rates,  and  routes  the  voice  and  data  traffics,  in  a  manner  that 
attempts  to  satisfy  the  optimality  conditions  we  shall  derive. 


3.2  The  solution 

Theorem  3.1  Let  u  =  '"ij’  ®  feasible  point 

of  (2.14)  through  (2.16).  Then  u  minimizes  (2.13)  if  and  only  if  there 
exist  two  sets  of  numbers  X  =  {X.  .}  and  y  =  »  with  X..  =  0  and 

y..  =  0,  such  that  the  following  Kuhn-Tucker  conditions  are  satisfied. 


®ik' 


(F,k) 


kj 


=  ^•j 

if 

fllU)  >  0 

i  ^ij 

if 

=  0 

(3.1) 

/  =  y.  . 

if 

>  0 

-  ^ij 

if 

=  0 

(3.2) 

•TT" 
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if  0  < 

■  8  '^ij  ^^ij^ 

1  ~ 

if  t*j  =  0 

(3.3) 

>  X. . 

*  “ij 

1 

if  0  <  rt  <  r*? . 

ij  ij 

1  * 

if  r*.  =0 

1 

(-  'ij 

*  d 

ij  ij 

(3.4) 

where  B.j|^(Fy|^)  denotes 

the  derivative  of 

B^kC^ik^*  etc.  The  proof  of  this 

theoretn  is  given  in  Appendix  A. 


3.2.1  Definitions.  A  voice  route  rJ.  between  nodes  i  and  j  is  a  set 
of  links  {(i,k),  (k,t),...,(m,j)}  which  connects  nodes  i  and  j  and 
along  which  voice  traffic  flows  from  node  i  to  node  j.  We  define  a 
data  route  in  a  similar  manner. 

We  can  interpret  the  quantity  +  g!|^(F.|^)  as  the  marginal 

cost  of  voice  traffic  on  link  (i.k),  or  the  "voice  length"  of  link  (i,k). 
Similarly,  the  quantity  can  be  interpreted  as  the  marginal  cost 

of  data  traffic  on  link  (i.k)  or  the  "data  length"  of  link  (i,k).  Since 
^  solve  for  and  u,-,-  recursively  to  obtain 


- 


Oi.k)ER;j 


*zk 


(3.5) 


(3.6) 


.  I ~r*TigihiiriftrrfT  r'' 


Then  we  can  interpret  X..  as  the  marginal  voice  cost  of  congestion  on 

'  J 

a  path  rYj  of  optimal  flow,  or  the  voice  length  of  path  when  flow  is 
optimal.  Similarly,  we  can  interpret  p..  as  the  marginal  data  cost  of 

*  J 

congestion  on  a  path  R?.  of  optimal  flow,  or  the  data  length  of  path 

*  V 

R^j  when  flow  is  optimal.  Equations  (3.1)  and  (3.2)  then  state  that  all 
traffic  flows  along  paths  of  minimum  marginal  cost,  i.e.  "shortest"  paths. 
In  (3.5)  and  (3.6)  X. .  and  y..  are  defined  as  properties  of  the  optimal 

I  J  I  4 

flow  and  are  difficult  to  find  without  solving  the  optimization  problem. 

We  shall  need  a  form  of  X. •  and  y . .  in  our  joint  flow  control  and  routing 
algorithm.  Therefore,  we  shall  redefine  X..  and  y..  in  terms  of 

I  J  I  J 

measurable  quantities,  as  functions  of  an  arbitrary  flow  as  follows: 


X  . . 

ij 


E  „  cb;,  (f;,)  . 


Min 

R^^ 


(S<.k)cRjj 


(3.7) 


(3.8) 


When  flow  is  optimal,  the  X..  obtained  from  (3.5)  is  equal  to  that 
obtained  from  (3.7);  and  they..’s  obtained  from  (3.6)  and  (3.8)  are  equal. 

*  V 


3.2.2  The  Priority  Functions  [19] 

We  define  the  voice  priority  function,  p^j(A.jj),  for  voice 
conversation  (i,j)  as  follows: 


-  ?  ''IJ 


Similarly,  we  define  the  data  priority  function,  9^j(''^j)» 


(3.9) 


conversation  (i,j)  as 


(3.10) 


Then  we  can  restate  the  optimality  conditions  C3.3)  and  (3.4)  as  follows: 


/ "  j 

if 

0  < 

★ 

1. .  <  a . . 
ij  ij 

P..  U*j)  |-^ij 

ij  'J  j 

if 

★ 

‘ij 

=  0 

(3.11) 
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(  -  ^ij 

if 

^ij 
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if 

0  < 

*  d 

r. .  <  r . . 
ij  U 

\ 

★ 

if 

'"ij 

=  0 

(3.12) 

I  >  u. . 

1  ^  t 

if 

★ 

•rt 

Recall  that  in  section  2.2.2  we  stated  that  the  solution  to  the  integrated 
network  problem  resides  in  finding  an  optimum  compromise  between  speech 
quality  and  voice  delay,  and  between  data  input  rate  and  network  congestion. 
The  priority  functions  have  an  interesting  interpretation  in  this  regard. 
First,  the  priority  functions  P4i(it.-4)  ai^e  the  marginal  gain  in  voice 

•  V  *  w 

quality  for  an  additional  voice  packet  length  allocation.  What  (3.11) 
states  is  that  optimality  occurs  when  the  marginal  gain  in  voice  quality 
is  as  close  as  possible  to  the  marginal  voice  cost  of  congestion  A. ., 

•  J 

*  .  , 
subject  to  0<  a.,  <  a...  The  equilibrium  point  (or  point  of  optimal 

1  J  I  J 

tradeoff ). for  any  voice  conversation  is  attained  when  its  marginal  gain 
in  quality  equals  its  marginal  cost  of  congestion.  At  any  other  point 
the  marginal  cost  of  congestion  of  that  conversation  will  be  either  greater 
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than  or  less  than  its  marginal  gain  in  quality.  This  means  that  any 
improvement  in  quality  at  the  non-optimal  point  would  be  obtained  at 
the  expense  of  voice  packet  delay,  and  vice  versa.  The  same  explanation 
holds  for  data  conversations,  A  desirable  flow  control  algorithm  would 
then  be  one  that  attempts  to  equalize  these  two  sets  of  marginal  values 
for  each  conversation.  In  section  3.2.3  we  shall  exploit  the  above 
fact  in  setting  the  voice  packet  lengths  and  the  data  input  rates.  In 
section  3.4  we  shall  consider  a  class  of  priority  functions. 

3.2.3  A  Joint  Flow  Control  and  Routing  Algorithm 

The  joint  flow  control  and  routing  algorithm  we  propose  performs 
four  different  network  functions:  it  effects  voice  flow  control  by 
setting  the  voice  packet  lengths  to  values  appropriate  for  the  network 
conditions;  it  effects  data  flow  control  by  setting  data  input  rates  to 
appropriate  values;  and  it  routes  voice  and  data  traffics  along  the  shortest 
paths.  There  are  two  approaches  to  defining  the  algorithm.  We  call  these 
approaches  the  "all-at-once  protocol"  and  the  "cyclic  coordinate  protocol". 

In  the  all-at-once  protocol,  the  algorithm  performs  all  the  four 
network  functions  simultaneously  during  each  iteration.  In  the  cyclic 
coordinate  protocol,  the  algorithm  performs  the  four  network  functions  in 
a  step-by-step  manner,  changing  one  parameter  (or  coordinate)  at  a  time. 
Specifically,  after  an  update  of  the  network  condition  is  made,  voice 

f 

flow  control  is  effected;  another  update  is  made  after  a  steady  state  has 
been  reached,  and  voice  routing  changes  are  made,  Then  after  another 
steady  state  is  reached,  another  update  is  made  and  data  flow  control 
is  effected.  Then  again  another  update  is  made  after  another  steady  state 
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is  reached,  and  data  routing  changes  are  made.  The  process  Is  repeated 
starting  with  another  update  followed  by  voice  flow  control.  Thus  there 
are  four  updates  to  complete  one  iteration  of  the  algorithm.  The 
convergence  of  the  cyclic  coordinate  algorithm  appears  to  be  slower  than 
that  of  the  all-at-once  algorithm.  We  shall  consider  only  the  all-at- 
once  algorithm  here. 

Our  joint  flow  control  and  routing  algorithm  belongs  to  the  class 
of  algorithms  proposed  by  Bertsekas  [2].  This  class  of  algorithms 
operates  in  the  space  of  path  flows  rather  than  link  flows  in  which  our 
problem  is  defined.  However,  the  correspondence  between  a  problem  defined 
in  the  space  of  link  flows  and  one  defined  in  the  space  of  path  flows 
can  be  easily  established  [2]. 

An  iteration  of  the  algorithm  starts  with  each  node  i  computing 
the  shortest  voice  and  data  distances  from  itself  to  every  node  j  for 
which  node  i's  conversations  are  destined.  We  shall  explain  how  distance 
computation  is  carried  out  later.  The  metric  for  distance  computation 
is  the  marginal  cost  of  congestion  on  each  link  sunned  over  all  links 
on  the  path  from  node  i  to  node  j.  Generally  there  may  be  two  or  more 
paths  that  qualify  for  the  shortest  path  for  each  (i,j)  pair.  Voice 
packet  lengths  and  data  input  rates  are  increased  or  decreased  according 
to  whether  the  priority  functions  are  greater  than  or  less  than  the 
shortest  distances.  Routing  changes  are  made  as  follows.  The  traffic 
on  each  non-shortest  path  is  decreased  by  an  amount  proportional  to  the 
difference  between  the  length  of  that  path  and  the  length  of  the  shortest 
path.  The  traffic  on  the  shortest  path  is  then  the  total  traffic  generated 
by  the  (i,j)  conversations  less  the  traffic  routed  along  the  other  paths. 


If  tv«o  or  more  paths  qualify  for  the  shortest  path,  we  arbitrarily  choose 
one  of  them  to  perform  the  function  described  above. 


Let  the  state  of  node  i  at  iteration  n  be  denoted  by 
u"  *  {aJ.  ,  rj.,  ■fiJCj)} 


(3.13; 


ij  '  ij' 

Since  there  may  be  more  than  one  shortest  path  for  voice  and/or  data 
conversations  (i,j),  we  define  the  joint  flow  control  and  routing 
algorithm  H  as  follows.  Let 

U  =  the  set  of  feasible  points  of  (2.14)  through  (2.16). 

Then  the  algorithm  H  is  a  point-to-set  mapping:  it  maps  a  point  ueU 
into  a  set  of  points  contained  in  U.  Thus  for  eU,  the  algorithm  yields 
H(u^‘^LI  from  which  an  arbitrary  element  u^^^  is  selected.  Thus  given  an 
initial  point  u°,  the  algorithm  generates  sequences  through  the  iteration 
[25]: 


a"*’  e  H(u'’) 


(3.14) 


B  Y  n. .  A.. 
’  ij  iJ 


the  total  expected  rate  of  all  the  voice  conversation 
entering  the  network  at  node  i  and  destined  for  node  j 
at  iteration  n. 


.dn 


’ij 


ij  ij 


the  total  expected  rate  of  all  data  conversations 
entering  the  network  at  node  i  and  destined  for 
node  j  at  iceration  n 


For  each  a  =  (i,j)  cA  ,  denote  by  s'^^(a);  and 

for  each  a  =  (i,j)  eA^,  denote  by  s^'^(a) 

P-  =  the  set  of  directed  paths,  with  no  repeated  nodes,  originating 

a 

at  node  i  and  terminating  at  node  j 
Sp”  =  the  total  voice  flow  for  a  e  A^  along  patl’i  pcP^  at  iteration  n 

Sp”  =  the  total  data  flow  for  a  eA^  along  path  peP^  at  iteration  n 

Then  the  relationship  between  the  link  flows  and  F^j^  and  the  path 
flows  is  given  by 


_vn 
^k  “ 

E 

aeAy 

E  “pi 

pcPg 

i.k) 

(3.15) 

pdn 

'‘ik  ' 

E 

“‘d 

2  “p( 

pePa 

i.k)  S^" 

(3.16) 

where  the  incidence  term5p(i,k)  is  defined  as  follows: 

(  1  if  link  (i ,k)ep 

5p(i.k)  =  I 

(o  otherwise 

<‘11:  -  “Ik  (Q "  “Ik  (fik) 

=  the  voice  length  of  link  (i,k)  at  iteration  n 
•^ik  “  ®ik  ^''ik^ 

*  the  data  length  of  link  (i,k)  at  iteration  n. 

Then  for  each  a  e  A^  and  peP^  we  define  the  voice  length  of  path  p  at 
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iteration  n  as 


iVn 


jvn 


G3.17) 


P  (Jl,k)ep 

Similarly,  for  each  a  eA^  and  p  eP^  we  define  the  data  length  of  path  p 


at  iteration  n  as 
.dn 


(i.k)ep 


(3.18) 


Finally,  we  define  the  shortest  voice  and  data  distances  from  node  i  to 
node  j  at  iteration  n  as 


iVn. 


^dn/ 


.Mr.  d''" 

(3.19) 

pcP,  " 

=  H.n  df" 

(3.20) 

peP,  P 

respectively.  Many  efficient  methods  exist  for  finding  shortest  paths  in 
a  ne^ork;  some  of  these  methods  are  given  in  [23].  Then  the  joint  flow 
control  and  routing  algorithm  can  be  formally  given  as  follows: 

A  Updating  At  Iteration  n 

1.  Each  node  i  broadcasts  (F^j^)  and  (F^j^)  for  each 
keO(i) 

2.  After  receiving  the  above  information  from  all  nodes,  each  node  i 
computes  the  path  lengths  d^”  and  d^"^  for  each  p  such  that 
Sp"  >0  and  sj"  >  0: 


ivn 


,  ,  ^vn  *  ®ik  <''"k» 

U,k)ep:Sp  >0 
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E 

(il.k)ep:S 


dn 

P 


>0 


I 


3. 


The  minimum  voice  and  data  distances  between  nodes 
then  computed  as  follows; 

(('"(a)  =  Min  d'" 

paP^  P 


and  j  are 


d^"(a)  *  Min  d^" 

pcP^  P 

Usually  there  are  many  paths  from  node  i  to  node  j  ,  and  it  is  not 
computationally  feasible  to  find  the  length  of  every  path.  This  is  why 
in  step  2  we  require  that  only  the  lengths  of  those  paths  with  Sp^  >  0 
and  Sp*^  >  0  be  computed  for  voice  and  data  conversations,  respectively. 

4.  For  each  a  =  (i,j)  node  i  computes  the  voice  priority  function 
PaUj)  s'^'^(a)  >  0,  and  the  data  priority  function  q3(i"a)  if  s'^'^(a)  >  0. 


B.  Voice  Flow  Control 


5.  Let  Zj  =  d''"(a)  -  p^dlj) 


6.  £ 


n+1 


(3.21) 


if  0  <  <  a. . 


^a"  -  \  ^a  i 
-  n,  z;  <  0 


(3.22) 


where  n.  is  some  positive  scale  factor,  and  a. .  is  the  nominal  voice 

X  I J 

packet  length  defined  earlier.  What  this  algorithm  does  is  the  following: 
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(i)  if 

(ii)  If  <  d'"’(a). 


increase  l 
decrease  I 


n 

a  ’ 
n 

a  ’ 


£  <  a 
a  ij 

£"  >  0 
a 
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where  is  a  voice  shortest  path.  What  this  algorithm  does  is  the 
following.  It  measures  the  deviation  e^*^  of  the  length  of  each  path 
peP,  from  the  shortest  distance.  Then  it  decreases  the  flow  on  path  p 
by  an  amount  proportional  to  this  deviation,  and  routes  the  remaining 
voice  traffic  from  voice  conversation  acA^  along  a  shortest  path. Note 
that  ,  the  total  voice  traffic  entering  the  network  at  node  i 

and  destined  for  node  j  at  iteration  (n+l),  is  determined  by  the  voice 
flow  control  algorithm. 


E.  Data  Traffic  Routine 


Let  e^ 


dj"  -  d‘^'’(a) 

min  [Sp”  ,  T\^  ep'^] 


(3.28) 


(3.29) 


12.  S 


d(n+l) 


^dn  .^dn 
P  P 


P  ^  Pp 


(a)  -  Z*  p  =  p*  (3.30) 

P^Pd 


Qn  ” 

where  is  some  positive  scale  factor,  Sp  >0,  and  p^  is  a  data 
shortest  path.  The  operation  of  this  algorithm  is  similar  to  that  of  D. 
Note  that  we  assume  that  at  each  node,  voice  packets  would  be  transmitted 
before  the  data  packets,  in  the  spirit  of  the  non- preemptive  priority  voice 
packets  have  over  data  packets.  The  convergence  properties  of  the  joint 
flow  control  and  routing  algorithm  are  described  by  the  following 


Theorem  3.2  Let  u®  be  any  feasible  point  of  (2.14)  through  (2.16),  and 
let  J(u°)  Then  for  every  positive  number  J^,  there  exist  scale 
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factors  Tij^.  T^J.^  and  such  that 

Min  J(u), 
u 

for  all  n  ^  1 

This  theorem  states  that  there  exist  na*  n^,  n„  and  such  that 
if  we  start  at  any  feasible  point  u°  and  apply  the  point-to-set  mapping  H 
repeatedly,  the  set  of  points  {u^}  we  obtain  converges  to  a  point  which 
minimizes  J.  The  proof  of  this  theorem  is  given  in  Appendix  B. 

3.3  Discussion 

Our  routing  algorithm  is  similar  to  the  new  ARPANET  routing 
algorithm  [26]:  both  are  shortest  path  routing  algorithms.  However, 
each  uses  a  different  metric  for  distance  computation.  In  [26]  the 
distances  are  absolut,?  delay.s  averaged  over  10  seconds,  but  in  cur  work 
the  distances  are  the  marginal  delays  on  the  paths.  Also  in  our  work 
we  gradually  decrease  the  traffic  on  the  paths  that  are  no  longer  the 
shortest  paths  at  each  iteration,  thereby  ensuring  that  the  algorithm 
converges.  But  in  [26],  at  each  iteration  an  old  path  that  is  no  longer 
the  shortest  path  is  entirely  cancelled  and  all  traffic  is  shifted  to 
the  new  shortest  path.  This  type  of  algorithm  is  not  likely  to  converge  [2]. 

Our  routing  algorithm  is  also  similar  to  the  algorithm  proposed  by 


Lim  J(u  ) 
n^ 


where 


u"  e  H(u"‘‘')  , 


Segal  1  [29].  Both  are  shortest  path  algorithms  arid  use  the  marginal 
delay  for  distance  computation.  Also  in  both  algorithms  the  computation 
is  distributed.  However,  the  two  algorithms  differ  in  a  number  of  ways. 
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First,  in  [29]  the  algorithm  is  defined  in  the  space  of  link  flows. 

Secondly,  the  update  information  in  [29]  is  propagated  upstream,  starting 
from  the  destination  node  as  follows;  Each  node,  upon  receiving  the 
update  information  from  its  downstream  neighbor,  performs  the  necessary 
computation  and  forwards  the  result  to  its  upstream  neighbors  who  in  turn 
perform  similar  operations  and  pass  the  information  further  upstream, 
until  the  source  node  is  reached.  This  mode  of  update  information 
transmission  has  the  potential  for  generating  loops  that  could  prevent 
the  upstream  nodes  from  ever  receiving  the  update  information.  Specifically, 
if  there  is  a  link  (k,Jl)  such  that  fj^^^  (j)  >  0  and  >  0»  then  during 

an  update  node  k  needs  the  value  of  the  distance  to  compute  Xj^j 
and  node  A  needs  the  value  of  Xj^.  to  compute  X^j.  Then  a  deadlock  ensues 
and  no  further  upstream  forwarding  of  the  update  information  can  take 
place.  This  necessitates  the  introduction,  as  was  done  in  [29],  of  the 
concept  of  blocking  which  ensures  that  loop-freedom  is  maintained.  In 
cur  algorithm  the  update  information  is  broadcast  and  so  we  do  not  worry 
about  loop- freedom. 

Our  routing  algorithm  is  also  similar  to  the  algorithm  proposed  by 
Gallager  [12].  However,  that  algorithm  is  defined  in  the  space  of 
fractions  of  link  flows  rather  than  path  flows  in  which  our  algorithm 
is  defined.  Also,  because  of  the  way  the  update  information  is  trans¬ 
mitted  (same  as  for  [29]), the  issue  of  blocking  is  introduced  to  maintain 
loop- freedom.  The  original  idea  of  blocking  as  a  means  of  maintaining 
loop-freedom  was  formulated  in  [12]. 

Finally,  our  flow  control  algorithm  is  similar  to  that  of 
Golestaani  [19].  This  is  because  the  two  models  are  similar,  differing 


6 


only  in  the  fact  that  we  have  two  additional  cost  functions  for  voice 
traffic. 


A  Class  of  Priority  Functions 


We  have  defined  the  voice  and  data  priority  functions  as 

1  I 

Pm(S'm)  =  -  Q-  (O  ,  m  eA„ 

m'  p  m  m  v 


respectively.  Golestaani  [19]  introduced  the  concept  of  priority 
functions  in  data  networks.  He  also  considered  a  class  of  priority 
functions  which  enables  us  to  prioritize  the  different  conversations 
according  to  how  severely  they  are  to  be  cut  back  when  the  network 
loading  becomes  high.  We  shall  consider  this  class  of  priority  functions 
in  this  section  together  with  a  modified  form  of  this  class  of  priority 
functions  for  data  conversations.  Consider  priority  functions  of  the  form: 

>  0  (3.31) 

^m  «  >  0  (3.32 

m  ' 

We  define  v_  and  5_  as  the  voice  priority  index  for  voice  conversation  m, 
m  m  - — - 

and  the  data  priority  index  for  data  conversation  m,  respectively.  The 
quantity  a^^  is  the  nominal  voice  packet  length  defined  earlier.  The 
quantity  b^^j  is  the  nominal  input  rate  for  data  conversation  m.  Note  that 
we  do  not  know  r^  a  priori ,  but  we  still  assign  the  nominal  rate  b^^^  to 
conversation  m.  Figure  3.1  is  a  plot  of 
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Figure  3.1  Voice  Priority  Function 


The  priority  indices'  relate  to  the  extent  to  which  conversations 
get  cut  back  when  the  network  loading  becomes  high.  Conversations  with 
small  priority  indices  are  cut  back  more  severely  than  those  with  higher 
priority  indices.  As  can  be  seen  in  Fig.  3.1,  packet  lengths  of  voice 
conversations  with  high  remain  fairly  constant  over  a  wide  range  of 
values  of  But  packet  lengths  of  voice  conversations  with  lower 

values  of  vary  wildly  as  changes.  When  all  conversations 

have  high  priority  indices  it  is  no  longer  true  that  packet  lengths  remain 
fairly  constant.  This  is  because  when  congestion  sets  in  all  packets 
would  have  to  be  shortened  to  reduce  network  traffic.  And  since  all  the 
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conversations  have  the  same  order  of  importance,  they  would  all  then 

experience  severe  cutback  in  packet  length. 

As  we  noted  in  chapter  II,  the  nominal  voice  packet  length  a^^ 

relates  to  the  length  of  packets  required  to  produce  good  quality  speech. 

However,  for  fixed  values  of  and  v„,  the  higher  the  value  of  a„ 

m  m  m  m 

the  higher  is  the  value  of  5,^.  Since  the  amount  of  traffic  generated  by 

a  voice  packet  is  directly  proportional  to  its  length,  care  must  be  taken 

not  to  choose  such  values  of  a^  that  could  indirectly  induce  congestion. 

Similar  arguments  hold  for  the  choice  of  b^^. 

We  mentioned  earlier  that  we  do  not  know  r^  a  priori  but  still 

assign  a  nominal  rate  b^^.  It  may  turn  out  that  r^  >  b^^  and  an  assigned 

rate  r„  >  b„.  Observe,  however,  that  when  r„  >  b„  some  inversion  takes 
mm  mm 

place:  For  any  given  value  of  the  data  conversations  with 

lower  priority  indices  get  higher  rates  than  those  with  higher  priority 

indices.  If  this  is  the  desired  objective  of  the  network  designer,  then 

the  definition  of  given  in  (3.32)  is  enough.*  However,  it  may  be 

desirable  to  allow  the  higher  priority  conversations  (i.e.  those  with 

high  priority  indices)  to  have  higher  input  rates  at  all  times.  For 

this  purpose  the  definition  of  q  (r  )  could  be  modified  as  follows: 

mm 


0  <  rm  <  b_ 

m  —  m 


m  —  m 


(3.33) 


The  modified  priority  function  is  sketched  in  Fig.  3.2. 

5. 


63  “2 

\\ 


,  incijeasing  6 


Figure  3.2  Modified  Data  Priority  Function 

For  the  class  of  priority  functions  defined  by  (3.31)  and  (3.32) 
we  have  that  for  voice  conversations  mcAy  ,  when  =  a^^,  Pm^^m^  * 

When  this  happens  we  would  not  like  the  network  to  be  congested,  and 
we  would  not  like  to  unnecessarily  restrict  the  flows  to  some  arbitrarily 
small  values  since  this  is  one  way  of  avoiding  congestion.  Recall  that 
the  voice  flow  control  algorithm  operates  as  follows: 


(i) 

if 

P,n  <^1 

>  d'''^(m)  , 

it 

increases 

V 

(ii) 

if 

<  d''"(m). 

it 

decreases 

if  n"  >  0  ; 

IT) 

(111) 

if 

“  d'''’(m). 

it 

leaves 

unchanged. 

If  our  network  is  properly  designed  (and  we  have  no  reason  to  believe  it 

is  notl)  ,  it  will  operate  at  the  equilibrium  point  most  of  the  time. 

That  is,  p„(it![!)  =  d'^'^(m)  most  of  the  time.  We  would  like  to  know  what 
mm 

happens  when  ^  network  operates  at  the  equilibrium  point. 

Recall  that 

<1;  '  4  (4)  "  4  <4)  • 

d“"W.  Mfa  ■£  d“" 

(i,K)cp 

Assume  that  all  links  (i,k)  ep  have  the  same  flow,  and  hence  the  same 
vn 

value  of  d  ;  and  let  be  the  number  of  links  on  the  path  peP„. 

Ik  m  m 

Then  we  require  that  at  the  equilibrium  point  when  =  1. 

^m  ^ik  *  ^ik  “  network  operates  at 

the  equilibrium  point  with  =  a^^^,  the  voice  length  of  each  link 

(i,k)  ep  is  determined  by  the  number  of  links  on  the  path  p.  Furthermore, 

as  the  number  of  links  increases,  the  voice  length  d^.|^  decreases. 

For  example,  when  =  2,  dVjJ  =  0.5;  and  when  a ^  =  5,  dVj^  =  0.2.  This 

means  that  for  a  multi -hop  conversation  m,  the  condition  that  ^ 

at  the  equilibrium  point  implies  that  the  traffic  on  its  path  be  very 
light.  The  above  argument  for  voice  conversations  hold  for  data 
conversations.  In  sum  then,  when  we  choose  a  class  of  priority  functions 
p^(i|jj),  we  indirectly  define  the  nature  of  the  class  of  congestion  cost 
functions  that  are  compatible  with  it.  This  is  so  because  the  optimality 
conditions  demand  that  there  be  a  proper  scaling  between  the  congestion 
cost  functions  and  the  priority  functions. 
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CHAPTER  IV 

EXTENSIONS  TO  THE  BASIC  ALGORITHM 

4.1  Introduction 

The  functions  of  the  basic  algorithm,  the  joint  flow  control  and 
routing  algorithm,  are  the  setting  of  the  voice  packet  lengths  and  data 
input  rates  to  values  compatible  with  the  network  utilization,  and  the 
routing  of  the  voice  and  data  traffics.  In  this  chapter  we  consider  a 
group  of  protocols  for  extending  the  functions  of  the  algorithm.  In 
particular,  we  consider  a  quasi-static  protocol  that  is  used  to  reduce 
the  likelihood  of  discarding  many  voice  packets  which  may  arrive  late 
at  the  smoothing  buffers  due  to  high  network  loading.  We  also  consider 
protocols  for  dealing  with  congestion  on  a  more  dynamic  basis  than  the 
joint  flow  control  and  routing  algorithm  can  deal  with.  Finally,  we 
consider  the  place  of  the  cut-through  routing  protocol,  proposed  by 
Kermani  and  Kleinrock  [20],  in  the  integrated  network. 

Despite  the  flow  control  we  practice,  the  network  can  still  get 
congested.  This  can  be  caused  by  several  factors  including  the  following. 
The  joint  flow  control  and  routing  algorithm  is  intended  for  quasi-static 
applications  where  the  network  input  statistics  change  very  slowly. 

However,  in  practice  the  network  has  varying  input  statistics.  Between 
updates,  because  of  the  inherent  burstiness  of  data  conversations,  some 
data  conversations  may  decrease  their  desired  rates  to  values  less  than 
the  assigned  rates,  while  others  may  terminate  their  conversations  entire¬ 
ly.  Some  inactive  data  conversations,  and  voice  conversations  in  silence 
may  become  active.  If  voice  packet  lengths  and  data  input  rates  are  as¬ 
signed  on  the  basis  of  low  network  utilization,  then  the  new  active  sources 
may  generate  such  additional  traffic  that  could  drive  the  network  into  con- 


gestion.  Therefore,  the  joint  flow  control  and  routing  algorithm,  while 
reducing  the  likelihood  of  network  congestion,  is  not  a  perfect  safe¬ 
guard  against  congestion  because  it  will  not  be  able  to  track  the  chang¬ 
ing  i-nput  statistics.  To  do  this,  the  algorithm  would  have  to  be  up¬ 
dated  more  frequently,  which  requires  more  updating  protocols  and  hence 
a  reduction  in  the  effective  link  capacities  available  for  the  voice  and 
data  traffics. 

4.2  A  Direct  Method  of  Congestion  Control 

There  are  differing  views  on  what  to  do  when  the  network  gets  con¬ 
gested.  Some  researchers  propose  that  voice  packets  be  dropped  when  net¬ 
work  congestion  occurs;  and  if  congestion  persists,  then  some  data  packets 
be  dropped  next  [11].  The  reason  for  this  is  that  it  is  easier  to  drop 
voice  packets  because  the  speaker  can  easily  repeat  the  message  if  he 
does  not  get  a  response  in  time.  Moreover,  since  the  voice  packets  are 
likely  to  arrive  late  at  their  destinations  and  hence  be  discarded,  it 
is  better  to  get  rid  of  them  earlier  rather  than  waste  the  network  resources 
in  transmitting  them.  The  problem  with  dropping  voice  packets  as  a  means 
of  fighting  congestion  is  that  if  the  algorithm  that  determines  when  voice 
packets  are  to  be  dropped  is  not  dynamic  enough,  it  would  not  stop  drop¬ 
ping  packets  after  relieving  congestion. 

The  embedded  coding  scheme  of  Bially  et  al .  [3]  controls  congestion 
in  a  dynamic  manner,  and  is  adaptable  to  our  model.  Recall  that  in  that 
scheme  voice  is  encoded  into  the  more  important  packets  and  the  less 
important  packets.  The  less  important  packets  may  be  dropped  anywhere  in 
the  network  on  a  dynamic  basis,  according  to  the  network  loading  conditions. 
The  source  node  would  have  to  be  informed  of  any  packets  that  have  been 
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dropped  so  that  it  would  generate  only  the  more  important  packets.  We 
emphasize  at  this  point  that  this  scheme  is  equivalent  to  using  one  packet 
that  has  different  segments  of  different  orders  of  importance.  When  the 
network  loading  becomes  high,  the  less  important  segments  of  the  packet 
could  be  discarded  anywhere  in  the  network.  Flow  control  is  practised 
by  setting  the  voice  packet  length  to  a  value  compatible  with  the  network 
conditions  before  sending  it  into  the  network.  This  corresponds  to  drop¬ 
ping  the  less  important  segments  of  the  packet  at  the  source. 

We  would  like  to  make  a  distinction  between  flow  control  and  con¬ 
gestion  control,  even  though  the  two  terms  are  often  used  interchangeably 
in  the  literature.  For  our  purpose  we  define  flow  control  as  any  mechanism 
that  regulates  the  entry  of  traffic  into  the  network  in  order  to  avoid 
network  overload.  In  other  words,  flow  control  is  applied  at  the  entry 
points  of  the  traffic.  Thus,  voice  packet  length  setting  and  data  input 
rate  setting  are  examples  of  flow  control.  By  congestion  control  we  mean 
any  mechanism  that  alleviates  high  network  loading  by  acting  on  the  traf¬ 
fic  already  inside  the  network.  Thus  by  this  definition,  the  embedded  cod¬ 
ing  scheme  of  Bially  et  al .  [3]  is  a  congestion  control  scheme  and  not  a 
flow  control  scheme. 

In  addition  to  effecting  flow  control  we  propose  to  practise  congestion 
control  in  the  integrated  network.  Our  approach  is  similar  to  the  embedded 
coding  scheme  [3].  After  setting  the  voice  packet  lengths,  each  voice 
packet  would  be  encoded  into  different  segments  of  different  orders  of 
importance.  As  in  [3],  when  the  network  loading  becomes  high,  the  less 
important  segments  of  the  packet  could  be  discarded  anywhere  in  the  net¬ 
work.  The  more  important  segments  reaching  the  destination  are  considered 


capable  of  producing  an  acceptable  speech  quality,  but  the  quality  is 
lower  than  would  be  the  case  if  the  packet  was  received  with  all  segments 
in  place. 

The  difference  between  our  proposed  scheme  and  that  in  [3]  is  that 
we  first  practise  flow  control  before  practising  congestion  control.  In 
[3]  no  flow  control  is  practised.  Also  we  have  no  need  for  a  mechamism 
for  informing  the  source  node  of  the  dropped  segment  because  the  flow  con¬ 
trol  algorithm  will  take  care  of  that  by  setting  the  voice  packet  lengths 
to  compatible  values  at  the  next  iteration. 

4.3  The  Variable  Voice  Packet  Delivery  Rate  Strategy 

We  require  that  voice  packets  be  delivered  to  the  sink  from  the  smooth¬ 
ing  buffers  at  the  same  rate  B  at  which  the  voice  digitizer  emits  them  in¬ 
to  the  network.  However,  when  the  network  gets  congested,  voice  packets 
arrive  very  late  and  so  the  smoothing  buffers  would  be  delivering  packets 
to  the  sink  faster  than  new  packets  arrive  at  the  buffers.  In  this  case 
many  of  these  packets  would  be  discarded  because  of  late  arrival. 

In  order  to  reduce  the  number  of  voice  packets  that  are  discarded, 
we  would  have  to  vary  the  rate  at  which  the  smoothing  buffers  deliver 
these  packets  to  the  sink  in  response  to  the  network  conditions.  Specifical 
ly,  when  the  network  loading  becomes  high  and  packets  arrive  later  than  be¬ 
fore,  we  decrease  the  packet  delivery  to  a  value  0*.  When  the  network 
loading  becomes  light  again,  we  increase  0*  back  to  B.  In  order  to  fully 
understand  the  effect  of  changing  the  packet  delivery  rate  to  S',  con¬ 
sider  the  delay  of  a  packet  that  enters  the  network  at  time  t  and  leaves 
the  network  (i.e.  is  delivered  to  the  sink)  at  time  d;  see  Figure  4.1. 
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T  T  +  1/e  T  +  n/e 


Figure  4.1  Additional  Delay  Caused  By  Change  In  3 

As  can  be  seen  from  the  figure,  a  packet  that  enters  the  network  at  time 
T  +  n/3  is  expected  to  be  at  the  smoothing  buffers  no  later  than  d  +  n/B', 
sustaining  a  maximum  delay  of 

(d  +  1^)  -  (T  +  n/6  )  =  (d-T)  + 

without  being  thrown  away.  If  3  *  B',  then  this  packet  would  be  expected 
to  suffer  a  maximum  delay  of  (d-r).  But  with  3  ^  6',  we  permit  the  packet 
to  suffer  an  additional  delay  of  ^  without  being  thrown  away  when 

it  arrives.  Note  that  this  additional  delay  increases  with  time.  Thus 
the  packets  that  enter  the  network  long  after  we  have  switched  the  deliv¬ 
ery  rate  from  8  to  S'  have  less  chances  of  late  arrival  than  those  that 
enter  immediately  after  the  switch.  Since  the  variation  of  voice  deliv¬ 
ery  rate  affects  the  voice  quality,  the  value  of  n(3-3’)/33'  should  be 
such  that  is  a  compromise  between  the  probability  of  discarding  fewer 
packets  and  the  amount  of  quality  degradation  the  sink  can  tolerate.  We 
can  define  a  priori  how  large  we  would  make  the  additional  delay 
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n(&-B')/BS'.  When  this  predetemined  value  is  reached,  we  revert  to  S 

whether  congestion  still  persists  or  not. 

4.4  A  Congestion  Avoidance  Protocol 

The  joint  flow  control  and  routing  algorithm  uses  YOi-  as  its  esti- 

*  J 

mate  of  nl.  in  setting  the  voice  packet  lengths.  This,  as  we  have  noted, 

*  j 

is  due  to  the  fact  that  it  is  difficult  to  use  the  instantaneous  values 
of  nl.  on  a  global  basis.  This  difficulty  results  in  occasional  inci- 

*  w 

dence  of  heavy  network  loading,  which  in  turn  necessitates  such  actions 
as  the  shortening  of  voice  packets  and  the  varying  of  the  voice  packet 
delivery  rate,  as  we  recommended. 

It  is  possible  to  use  the  n|.  on  a  local  basis,  especially  in  a 
manner  that  would  enable  each  source  node  i,  which  sends  traffic  to 
destination  node  j,  to  permit  some  maximum  variation  of  the  (i,j)  voice 
traffic  from  the  expected  rate.  The  total  expected  rate  of  all  voice 
(i,j)  conversations  is  Byn.  .tt.,  where  is  the  value  of  the  voice 

1^1^  i  J 

packet  length  determined  by  the  algorithm.  If  at  any  time  hj.  greatly 

^  J 

exceeds  Yn,:-->then  the  network  may  be  tending  to  congestion  because  of 

'  %j 

the  increased  rate  over  and  above  the  expected  rate.  We  propose  that 
the  total  instantaneous  voice  rate  for  the  (i,j)  conversations  be  limited 
to  a  value  no  greater  than  BCrn.-^-  +  e(n.  -)]2.T.,  for  some  choice  of  e(n  .  -) 
to  be  explained  later.  Specifically,  let  2-4 i(t)  be  the  instantaneous 
value  of  At  each  instant  that  voice  packets  are  to  be  constructed, 

note  i  makes  the  following  decision: 

Cvn,; 


,  otherwise 


(4.1) 


This  strategy  can  be  explained  as  follows.  That  we  are  dealing  with 


average  rates  means  that  we  recognize  that  fluctuations  about  the  mean 
value  exist.  But  since  voice  traffic  is  delay-sensitive,  we  cannot 
tolerate  large  upswings  in  voice  traffic.  Therefore,  we  limit  the  maxi¬ 
mum  upswing  to  BCyn^^  +  £(n^-)]ilT-.  When  traffic  exceeds  this  value,  we 
degrade  the  voice  quality  of  all  the  (i,j)  voice  conservations  through 
assigning  shorter  packets  that  would  force  the  traffic  down  to  where  we 
can  tolerate.  The  choice  of  e(n..)»  the  maximum  amount  by  which 
exceeds  yn..  before  action  is  taken,  depends  on  the  value  of  n...Specifi- 

cally,  since  the  standard  deviation  of  nl,-  is  proportional  to  /n . . ,  we 

J  1  j 

permit  the  instantaneous  values  of  nl.  to  exceed  some  standard  deviations 

*  J 

(or  fraction  of  a  standard  deviation)  before  we  take  any  action  on  the 
traffic.  Thus  functions  of  the  form 


e  (n^j)  =  k  /n^j 

where  k  >  0  is  a  constant,  are  appropriate  for  this  purpose. 

4.5  A  Strategy  For  Admitting  New  Conversations 

As  the  joint  flow  control  and  routing  algorithm  shows,  we  make  small 
routing  changes  at  each  iteration  in  order  to  ensure  that  the  algorithm 
converges.  Therefore,  anv  decision  to  admit  new  conversations  into  the 
network  should  be  made  in  such  a  way  that  large  changes  are  not  made  in 
the  flow  pattern.  For  all  conversations  in  the  network  let 

-  the  minimum  acceptable  voice  packet  length 
r^  *  the  minimum  acceptable  data  input  rate 
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That  IS,  if  a  voice  conversation  is  assigned  a  packet  length  less  than 
Hq,  it  opts  out  of  the  network  rather  than  transmit  at  the  assigned  rate. 

A  similar  situation  holds  for  r.  For  each  voice  conversation  a,  let 

X  =  some  threshold  packet  length  (whose  meaning  we  shall  explain 

a 

shortly) 

d^(a)  =  some  threshold  voice  path  length 

dn'^(a)  =  the  path  length  of  the  longest  path  that  voice  conversations 
P* 

a  are  using  at  iteration  n. 

Similarly,  for  each  data  conversation  a,  let 

r.  =  some  threshold  input  rate 

d^(a)  *  some  threshold  data  path  length 

d^^(a)  =  the  path  length  of  the  longest  path  that  data  conversations 

P* 

a  are  using  at  iteration  n. 

Then  the  admission  policy  we  propose  is  the  following: 

1.  If  d)[^(a)  <  d'JCa)  and  a”  >  £,  at  iteration  n,  then  and  only  then 

p*  —  0  a  —  a 

will  node  i  admit  one  new  voice  (i,j)  conversation,  where  a  =  (i,j), 
during  period  n. 

2.  If  d^''(a)  <  d^{a)  and  r”  >  r  at  iteration  n,  then  and  only  then  will 

p^  “0  a  —  a 

node  i  admit  one  new  data  a  conversation  during  period  n. 

This  admission  policy  can  be  explained  as  follows.  We  would  not 
admit  any  new  voice  (i,j)  conversation  when  the  old  (i,j)  conversations  (i.e. 
those  already  in  the  network)  have  a  delay  greater  than  some  threshold 
d^(a).  Also  we  would  not  admit  any  new  voice  (i,j)  conversations  when  the 
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old  conversations  have  packet  lengths  that  are  very  close  to  the  minimum 
acceptable  value  Therefore,  we  must  ensure  that  both  the  delay  per¬ 
formance  and  quality  of  all  old  a  conversations  are  of  accepable  standards 
(which  can  be  set  a  priori)  before  we  admit  any  new  a  conversation.  And 
the  reason  for  restricting  the  admission  to  at  most  one  voice  conversation 
per  source-destination  pair  per  period  is  to  make  small  changes  to  voice 
traffic  at  a  time  as  much  as  possible.  The  same  arguments  hold  for  the 
data  conversations. 

An  indication  of  how  to  choose  can  be  seen  from  Figure  4.2.  As 

the  figure  shows,  X  is  close  to  the  nominal  packet  length  a... 

a  1  j 


h 

I 


o 


1/2  (a..  +  Zq) 


a,! 


Figure  4.2  Choice  of  Threshold  Packet  Length 


Not”  that  the  newly  admitted  voice  conversation  would  be  assigned  the 
current  value  of  packet  length  and  routed  along  the  shortest  path.  Similarly, 
for  data  conversations,  the  new  a  conversation  would  be  assigned  the  cur¬ 
rent  input  rate  of  the  a  conversations.  If  the  rates  are  translated  in¬ 
to  window  sizes  (see  section  4.7),  then  the  new  data  conversation  would 
be  assigned  the  current  window  size,  and  routed  along  the  shorest  path. 

4.6  Constrained  Voice  Packet  Lengths 

As  mentioned  in  the  previous  section,  assume  we  have  a  minimum 
acceptable  voice  packet  length  Furthermore,  let  belong  to  a  set 
L  of  admissible  voice  packet  lengths: 
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L  =  {0,  2.^,  3^- j  J  (4.2) 

where  0  <  <  2.^  <  ...  <  a.^.  Let  the  "raw  packet  length"  obtained  from 

the  flow  control  algorithm  be  l;  and  let  I  satisfy  the  condition 

- —  a  a 

A|^_1  <  where  2-1^  e  L.  Then  we  are  required  to  set  2,^  to 

Ak 

some  value  2,^  e  L. 

a 

The  problem  with  this  type  of  extra  constraint  is  that  it  could  up¬ 
set  the  convergence  of  our  algorithm.  One  way  to  get  around  this  problem 
is  to  divide  the  voice  (i.j)  conversations  arbitrarily  into  two  groups,  A  and 
B.  Then  we  use  the  following  assignment  rule: 

2,|^  for  group  A 

\.1  f'or  group  B  (4.3) 

where  the  dividing  line  for  group  membership  should  be  drawn  in  such  a 
way  as  to  make  the  net  traffic  remain  close  to  the  level  given  by  the 
flow  control  algorithm.  That  is, 

yn^Jlg  «  |Al£^  +  |B|)l^_^  (4.4) 

where  [Xj  is  the  cardinality  of  set  X.  In  this  way  we  avoid  the  over- 

A 

load  caused  by  letting  all  conversations  be  assigned  2,^  =  and  the 

A 

under-utilization  caused  by  assigning  2,^  =  2.|^_.|  to  all  conversations. 
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4.7  Implementation  of  Data  Flow  Control 

We  have  discussed  how  flow  control  can  be  effected  in  the  integrated 
voice  and  data  network;  Voice  packet  lengths  and  data  input  rates  are  set 
in  response  to  the  network  conditions.  For  voice  conversations  we  assume 
that  we  can  find  a  voice  digitizer  which  generates  packets  of  appropriate 
lengths  at  a  constant  rate  of  6  per  second  whenever  a  speaker  is  in  talk- 
spurt  [3].  Thus  if  such  a  hardware  is  found,  voice  flow  control  can  be 
easily  implemented.  For  data  conversations  the  input  rates  are  controlled 
and  the  packet  lengths  are  assumed  to  be  independent  of  network  control. 

Assume  the  expected  data  packet  length  is  r  bits  and  the  optimal  input  rate 

★  ★ 
of  data  conversation  m  is  r.  Then  in  order  to  implement  this  rate  of 

bits/sec.,  the  packets  of  this  conversation  would  be  sent  into  the  network 

★ 

at  an  average  rate  of  r^/T  per  second.  As  we  mentioned  earlier,  that  we 

have  effected  flow  control  does  not  guarantee  a  congestion- free  operation. 

Often  statistical  fluctuations  arise  that  cause  the  flow-controlled  network 

to  be  congested.  Thus  a  strict  adherence  to  sending  packets  into  the  network 

* 

at  an  average  rate  of  r^  /T  may  not  be  a  good  strategy,  especially  when 

congestion  sets  in.  What  is  required  then  is  a  scheme  that  will  not  only 

★ 

restrict  the  input  rates  to  the  optimal  values  r^^  but  also  respond  dynami¬ 
cally  to  the  network  conditions  between  updates. 

A  common  approach  to  effecting  flow  control  in  a  data  network  is 
the  so-called  window  strategy  [6,15].  In  this  strategy  each  source  node 
i  keeps  the  number  of  unacknowledged  (or  outstanding)  packets  in  the 
network,  of  each  conversation  destined  for  node  j,  below  a  given 
number  w. .  called  the  window  size  (or  window  width).  Thus  a  new  packet 

*  V 

cannot  be  sent  into  the  network  if  the  number  of  outstanding  packets  of 
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conversation  (i,o)  at  that  time  is  equal  to  v/.  ..  This  is  a  dynamic  scheme 

*  J 

because  when  the  network  is  heavily  loaded,  packet  acknowledgements  (ACKs) 

arrive  late  and  hence  the  frequency  of  packet  entry  into  the  network 

decreases.  On  the  other  hand,  when  the  network  loading  is  light,  ACKs 

arrive  faster  and  the  frequency  of  packet  entry  into  the  network  increases. 

One  question  we  may  ask  at  this  point  is:  Given  an  optimal  input 
★ 

rate  r^,  can  we  set  a  window  size  w^^^  such  that,  by  ensuring  that  the 

number  of  outstanding  data  packets  in  the  network  is  no  greater  than  w^^, 

* 

we  force  the  data  conversation  m  to  transmit  at  rate  r„?  It  turns  out 
that  under  certain  conditions,  which  we  shall  give  shortly,  the  answer 
to  this  question  is  yes.  Golestaani  [19]  shows  that  if  for  each  active 
conversation  {i,j)  (i.e.  one  that  is  not  silent)  there  are  packets  waiting 
to  enter  the  network  so  that  as  soon  as  a  new  ACK  arrives  at  node  i  a 
new  packet  enters  the  network,  there  is  a  unique  correspondence  between 
the  set  of  outstanding  packets  in  the  network  and  the  set  of  input  rates 
of  these  conversations.  The  implication  of  this  statement  is  the  following. 
Since  the  window  strategy  is  a  dynamic  scheme,  we  can  practise  it  as  an 
indirect  enforcement  of  the  flow  control  algorithm  for  those  conversations 
that  meet  the  necessary  conditions. 

The  motivations  for  practising  the  window  strategy  in  a  data  net¬ 
work  carry  over  to  the  integrated  network.  However,  the  window  strategy 
cannot  be  applied  to  voice  conversations.  This  is  not  only  because  we 
set  the  voice  packets  to  the  desired  lengths  and  strictly  send  them  into 
the  network  at  a  constant  rate  of  $  per  second  but  also  because  the 
assigned  window  size  may  be  less  than  the  number  of  voice  packets  generated 
during  a  talkspurt.  This  would  lead  to  loss  of  continuity  in  the  conver  - 
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sation,  an  undesirable  feature  in  any  voice  conversation. 

In  deriving  the  relationship  between  r^  and  Golestaani  [19] 
defined  a  function  which  is  the  average  delay  per  packet  on 

link  Jl  including  processing  and  queueing  delays  at  the  input  to  link  %. 
He  assumed  that  is  a  convex  increasing  and  differentiable  function 

of  the  aggregate  flow  on  link  1.  In  our  model  the  link  delay  of  a 
data  packet  is  not  only  dependent  on  the  aggregate  link  flow  but  also 
on  what  proportion  of  that  link  flow  is  voice  traffic.  For  example, 
consider  a  link  flow  of  one  unit.  If  the  voice  traffic  is  0.3  units, 
then  the  data  packet  delay  would  be  smaller  than  the  case  where  the  voice 
traffic  is  0.7  units.  In  the  latter  case  a  data  packet  is  likely  to  wait 
a  long  time  as  newly  arriving  voice  packets  receive  service  before  it. 

Thus  in  our  analysis  of  the  window  strategy  for  the  integrated  network 
we  define  tj^(Fj^,  Fp  to  be  an  increasing  and  differentiable  function  of 
both  F^  and  F^  ,  the  voice  traffic  on  link  t.  The  effect  of  the  presence 
of  voice  packets  on  the  data  packet  delay  is  to  modulate  the  link  delay 
according  to  what  proportion  of  the  link  traffic  is  voice  traffic.  The 
complete  relationship  between  r^^^  and  w^^^  can  be  obtained  as  follows.  Let 

r  =  the  input  rate  of  data  conversation  m 
m 

r  =  the  expected  data  packet  length 

w„  =  the  window  size  of  conversation  m 
m 

=  the  average  delay  of  ACKs  for  conversation  m.  is  assumed 
to  be  independent  of  the  network  conditions  if  the  ACK 
traffic  has  priority  over  other  traffics. 


-64- 


qn^  =  the  fraction  of  conversation  m  on  link  1.  For  uni  filar 

flow,  such  as  in  virtual  line- switched  systems,  q  ,  is 

mJl 

either  1  or  0,  depending  on  whether  or  not. 

m 

Then  from  Little's  formula  [24]  the  number  of  packets  of  conversation  m 
outstanding  in  the  network  at  any  time  is  given  by 


(4,4) 


*  d 

For  those  conversations  with  *  (^•^)  offers  a  nice  way  to  set  the 

window  size.  By  setting  w^^^  to 


w 


m 


(4.5) 


we  force  conversation  m  to  buffer  the  remaining  data  so  that  whenever 

an  ACK  arrives  there  is  a  packet  waiting  to  be  sent  into  the  network. 

*  d 

However,  for  those  conversations  with  r„  >  r„  ,  the  allocated  window  size 

m  m 

Wm  ^  ^m"’  allocated  widow  size  is  greater  than  the  number  of 

outstanding  packets  in  the  network  at  any  time.  For  such  conversations, 

arriving  packets  would  tend  to  enter  the  network  earlier  than  those  of  the 

previous  category  because  there  is  a  great  likelihood  that  at  any  time 

the  number  of  packets  outstanding  is  less  than  the  window  size. 

To  summarize,  the  window  strategy  enables  us  to  partition  the  data 

*  d 

conversations  into  two  groups:  those  with  r„  <  r„  and  for  whom  w„  =  u„, 

’  mm  mm 

*  d 

and  those  with  r  >  r  and  for  whom  w„  >  u  In  the  former  group  packets 
are  likely  to  be  buffered  in  wait  for  ACK  arrival  because  the  window  is 
likely  to  be  closed  (i.e.  the  number  of  outstanding  packets  equals  the 


window  size)  when  they  arrive.  In  the  latter  group  packets  are  likely 
to  enter  the  network  as  they  arrive  because  the  window  is  likely  to  be 
open  when  they  arrive. 

If  r*  <  r*^  for  all  m,  we  show  below  that  when  the  window  size  is 
m  m 

★  _ 

set  by  (4.4)  there  is  a  unique  correspondence  between  r^^  and  Wj^,  [ISJ. 
First,  we  note  that 


Therefore 


3 1 

*''m  E, ''Larr- 


,3wm  _ 


k  m 


Let  T  be  a  diagonal  matrix  with  elements  given  by 

^nin  *  '‘m  h 

^«m 

Q  =  a  matrix  with  elements 
R  =  a  diagonal  matrix  with  entries  =  r^^ 

3tj^ 

M  *  a  diagonal  matrix  with  entries  M  * 

*  I 


a  matrix  with  entries  “  r  jzr 


-66- 


Then  (4.6)  can  be  written  as 

P  =  T  +  RQMQ^  (4.7) 

Post-multiplying  by  R  we  obtain 

PR  =  TR  +  RQMqV  (since  R^  =  R) 


If  we  assume  that  >  0  for  all  m,  then  since  T,  R,  and  M  are  positive 
diagonal  matrices,  PR  is  a  positive  definite  matrix,  and  hence  is  invertible. 
Since  (PR)"^  =  R"^  P"\  and  since  R"^  exists,  then  P'^  exists.  This 

means  that  incremental  changes  in  window  sizes  lead  to  uniquely  defined 
changes  in  data  input  rates. 

In  the  way  window  strategies  are  generally  used  in  practice,  the 

window  size  of  each  conversation  remains  fixed  throughout  the  dura ton  of 

the  conversation.  However,  the  unique  correspondence  between  r  and  w 

mm 

suggests  that  w^^  could  be  adjusted  in  response  to  the  network  conditions. 

3  J  *  9J* 

Specifically,  when  >  0  we  need  to  decrease  w^^;  and  when  <  0  we 

need  to  increase  w^^^  [13].  One  problem  is  how  to  effect  this  window  size 
adjustment.  A  possible  method  is  to  change  w^j^  by  an  amount  corresponding 
to  the  desired  change  in  r^^^  [14];  namely 


“n,  *  V 

t 

The  problem  with  this  approach  can  be  seen  in  the  following  example. 
Consider  a  simple  network  consisting  of  one  link  and  two  nodes  and  02* 
^  This  example  is  due  to  Professor  Gallager 


Ar, 


A  w, 


m 


m 


Two  sources  transmit  at  rates  r^  and  r2  from  node  as  shown  in 
Figure  4.3.  If  we  assume  that  =  0,  then 


“i  *  r  *  '‘2’ 

Wj  .  ^  t(r,  +  r^) 


Figure  4.3 


(i) 


To  first  order 


Aw-j  = 

Ari  r^t 

r  r 

CAr^  +  Ar2] 

(ii) 

AW2  = 

Arp  r2t 

~  t  +  — ^ 

r  r 

CAr^  +  Ar2] 

(iii) 

that  r^ 

=  0,  r2  >  0;  and 

1^  =  -1. 
3r^ 

^  = 
9r2 

-2 

so  that  »  ^Aw2.  Then  from  (ii)  and  (iii)  we  have  that 


Aw, 


Ar.|t 


rot 


AWr 


A’"'>  '  ’2‘  A 

d  r*  j.  T  4.  —  Ar, 


=  — ^  [t  +  r-t  ]  + 


(iv) 

(v) 
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From  (iv) 


i  ^"2 


since  Aw^  =  1  ^'^2  ’  (v)  we  obtain 


Aw2(2t  -  Tgt  )  = 


2t(t  +  r2t  ) 


2t(t  +  r2t  ) 

Aw,  =  - T"  Ar, 

r(2t  -  r2t  )  ^ 

I  I 

If  we  assume  r2t  »  t,  then  r2t  >  2t  and 
AW2  =  -k  t  Ar2  ,  when  k  >  0 

That  is,  as  we  increase  the  window  size  we  decrease  the  rate.  Thus  this 
method  is  good  for  adjusting  the  window  size  of  inactive  conversations 
but  not  so  for  active  conversations,  when  it  is  applied  simultaneously  to 
the  two  groups.  Increase  in  the  window  size  of  the  former  is  accompanied 
by  an  increase  in  the  input  rate;  but  in  the  latter  it  is  accompanied  by 
a  decrease  in  the  rate. 


Consider  the  following  approach.  Let 


=  ■'"‘rnSr 
m 


(4.9) 


where  n  1s  some  positive  scale  factor.  As  pointed  out  in  [13],  this 

method  of  window  size  adjustment  has  some  nice  properties.  When  the 

★ 

window  size  changes  by  aw^^^  then  to  first  order  the  change  in  J  is 
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Aw 


m 


■^^3w  '”in  3r  * 
tn  m  m 


..Syl,  sol  ?!a 

m  3w„  m  3w„  3r„ 

'"  m  mm 

-  f  (v^  -  J*)  [TR  +  RQMq'^R]  (7^  •  J*)^ 


f  {\  •  J*)  PR  %  •  J*)^ 


(4.10) 


*  * 

where  *  J  Is  the  gradient  of  J  with  respect  to  w.  Since  PR  is 

*  ★ 

positive  definite,  AJ  <  0  if  J  Q.  Thus  this  method  leads  to  a 
descent  algorithm. 

Note,  however,  that  this  method  cannot  work  for  inactive  conversations 

(whose  r^j^  =  0).  And  since  the  condition  for  PR  to  be  positive  definite  is 

*  d 

that  all  conversations  have  w„  =  u„,  or  equivalently  r„  <  r„,  this 

m  m  ^  •'mm 

*  H 

method  is  also  not  apolicable  to  conversations  with  r„  >  r“.  We  can 
then  make  window  size  adjustments  in  the  following  manner:  For  inactive 
conversations  which  may  demand  a  larger  window  size  when  they  become  active. 


where  Ar^^^  is  their  desired  change  in  rate.  And  for  active  sources  whose 

*  H 

allocated  rates  <  r “  ,  use 


AW 


m 


-  nr. 


m 


3**, 


m 
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Generally  the  window  size  obtained  from  C4.5)  is  not  an  integer. 

In  practice,  however,  fractional  window  sizes  cannot  be  easily  implemented. 

A 

One  task  then  is  to  construct  integer  window  sizes  w^^  given  raw  values 
Wj^.  It  has  been  suggested  [19]  that  the  parameter  0^^  be  adjusted  in 
order  that  the  value  of  w^^  in  (4.5)  is  an  integer.  Thus  if  an  ACK 

I 

encounters  a  delay  it  is  further  delayed  by  an  amount 

I 

where  is  the  value  of  that  makes  (4.5)  an  integer.  The  manipulations 
of  the  ACK  delay  in  the  manner  we  have  described  above  to  achieve  integer 
window  sizes  means  rounding  w^  off  to  the  next  higher  integer.  This  in 
turn  means  permitting  more  traffic  into  the  network.  This  is  thus  likely  to 
upset  the  convergence  of  our  flow  control  algorithm.  To  avert  this 
potential  problem  we  make  the  following  proposal.  For  each  source-desti¬ 
nation  pair  (i,j),  node  i  will  partition  the  data  conversations  into 
two  groups,  A  and  B.  Members  of  group  A  will  be  the  most  important  data 
conversations  while  members  of  group  B  will  be  the  less  important 
conversations.  Members  of  group  A  will  get  the  window  size  allocation 
Wm  =  members  of  group  B  will  get  the  window  size  w^^  = 

where  the  partition  is  performed  in  such  a  way  that 

=  lA|  rw_l  +  iBi  Lw_J 
ij  m  '  '  m  '  '  m-* 

where  [xl  =  the  smallest  integer  greater  than  or  equal  to  x; 

[xj  =  the  largest  integer  less  than  or  equal  to  x. 

The  exact  demarcation  line  for  group  membership  would  depend  on  where  the 
above  approximate  equality  is  best  achieved. 


4.8  Cut-Through  Routing  of  Voice  Conversations 


Me  have  emphasized  the  need  to  route  the  voice  conversations  fast 
enough  for  them  to  be  available  at  the  destination  node  when  they  are 
required  for  delivery  to  the  sinks.  We  have  also  noted  that  voice 
conversations  are  not  particularly  sensitive  to  errors.  These  two 
factors  combine  to  make  the  cut  through  routing  [20]  a  good  strategy  for 
the  voice  conversations.  The  cut- through  routing  protocol  was  originally 
defined  for  data  networks  and  works  as  follows.  When  a  packet  arrives 
at  node  i  and  an  output  link  (i,k)  is  selected  for  it,  then  after 
receiving  the  packet  header  the  packet  transmission  starts  immediately 
without  link  (i,k)  waiting  to  receive  the  entire  packet  and,  therefore, 
without  checking  for  errors,  if  link  {i,k)  is  free.  Only  if  link  (i,k) 
is  busy  would  it  be  necessary  to  buffer  an  arriving  packet,  as  in  normal 
packet  switching  operation.  In  this  way  the  delay  associated  with  buffering 
to  receive  the  entire  packet  and  check  for  errors  in  front  of  an  idle  link 
is  eliminated.  A  cut  is  said  to  have  been  made  if  the  packet  successfully 
goes  through  the  link  without  waiting  to  receive  the  packet  before  trans¬ 
mission  starts. 

The  aim  of  this  section  is  to  point  out  the  possible  gains  that 
could  be  obtained  from  applying  the  cut-through  routing  protocol  to  voice 
conversations  in  the  integrated  network.  We  will  not  go  into  detailed 
analysis  of  the  scheme;  the  interested  reader  is  referred  to  [20].  We 
will  merely  make  a  somewhat  qualitative  comparison  between  the  cut- through 
routing  and  the  normal  packet-switched  operation.  We  distinguish  between 
two  types  of  cuts:  a  perfect  cut  and  a  partial  cut.  A  perfect  cut  is  the 
type  we  described  above;  where  a  packet  arrives  at  a  link  which  is  idle  and 
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"cuts  through"  without  having  to  wait.  When  a  packet  arrives  at  an  output 
link  that  is  busy,  it  waits  until  current  service  is  completed  whence  it 
receives  service  if  there  is  no  other  packet  in  queue.  If  the  remaining 
time  to  completion  of  the  service  of  the  current  packet  is  less  than  the 
time  to  receive  the  entire  packet  and  there  is  no  other  packet  in  queue, 
then  the  transmission  of  the  packet  can  start  while  part  of  the  packet 
is  still  being  received.  This  type  of  cut-through  is  called  a  partial 
cut  since  some  waiting  is  involved,  but  the  waiting  time  is  less  than  the 
time  to  receive  the  entire  packet.  This  virtual  waiting  time  may  also  be 
equal  to  the  time  to  receive  the  entire  packet  if  the  current  service 
ends  just  as  the  last  bit  of  the  packet  is  received,  In  [20]  only  perfect 
cut-through  routing  is  considered. 

We  present  an  approximate  analysis  of  the  cut- through  routing  to 
show  the  type  of  saving  in  packet  delay  that  can  be  derived  from  practising 
the  routing  strategy.  Assume  there  is  negligible  propagation  delay  on 
each  link  and  let 

s^.|^  =  the  total  service  time  of  a  tagged  packet  on  link  (i,k) 

Then  s^.j^  is  made  up  of  two  parts: 

^ik  “  '^ik  *  "^ik 

where  w^.j^  =  the  waiting  time  of  the  packet  on  link  (i,k) 

=  the  transmission  time  of  the  packet  on  link  (i,k) 

Without  cut- through  routing,  each  packet  encounters  both  a  waiting  time 
and  a  transmission  time  on  each  link:  Even  when  no  other  packet  is  in 
service,  the  tagged  packet  must  be  completely  received  before  transmission 
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can  start.  Thus  the  total  system  time  of  the  tagged  packet  when  cut- 
through  routing  is  not  practised  is 


2  Cw.,^  +  T..  ) 

Ci.klep 


(4.11) 


where  p  is  the  path  of  the  tagged  packet.  IVith  cut-through  routing, 
for  links  Ck,Jt)£p,  the  waiting  time  at  link  (.k,t)  starts  when 

transmission  starts  at  link  Ci.k).  Thus  except  at  the  output  link  of  the 
destination  node  where  the  entire  packet  may  possibly  be  completely  received 
before  being  delivered  to  the  sink,  the  transmission  time  at  any  inter¬ 
mediate  link  is  absorbed  by  the  waiting  time  at  the  successor  link  on 
the  path.  Therefore,  the  system  time  of  the  tagged  packet  is 


*  S  w,.  <■  Tf  (4.12) 

where  =  the  transmission  time  at  the  final  link.  From  (4.11)  and 
(4.12)  we  see  that  the  system  time  is  reduced  by  the  transmission  times 
on  all  but  the  final  output  link.  Note  that  in  practice  the  values  of 
the  w^i^  used  in  (4.11)  may  not  be  equal  to  those  used  in  (4.12)  because 
of  the  fact  that  perfect  cuts  might  be  made  in  some  links.  Under  such 
conditions  the  reduction  in  delay  would  be  greater  than  we  stated  above. 

The  tradeoff  in  the  cut-through  routing  strategy  is  between  delay 
and  errors.  A  packet  that  makes  a  cut  at  each  link  could  arrive  at  the 
destination  with  such  a  serious  error  that  would  necessitate  its  being 
discarded.  In  this  situation,  we  would  have  wasted  the  network  resources 
in  transmitting  that  packet.  Without  cut-through  routing,  such  a  packet 
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would  have  been  discarded  earlier,  if  the  error  proved  to  be  uncorrect- 
able,  without  the  network  resources  being  wasted  on  the  packet.  However, 
there  are  certain  errors  that  are  tolerable  in  voice  communication.  This 
means  that  we  can  practice  cut-through  routing  of  voice  traffic  in  the 
integrated  network.  We  hope  that  most  of  the  errors  we  would  encounter 
in  the  network  would  be  the  tolerable  type.  Under  this  condition  then 
the  cut-through  routing  scheme  would  provide  some  assistance  in  making 
the  voice  packets  meet  the  stringent  delay  requirements  of  the  integrated 
network. 
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CHAPTER  V 

A  CLASS  OF  INTEGRATED  NETWORK  MODELS 


Our  network  model  belongs  to  a  broader  class  of  models  for  integrating 
n  different  types  of  traffics  that  have  different  degrees  of  delay 
sensitivity  onto  one  network.  In  this  type  of  network  problem  it  is  very 
necessary  to  ensure  that  the  network  is  not  heavily  loaded  with  traffic 
from  the  very  delay-sensitive  traffic  type.  Assume  we  index  the  traffic  types 
in  a  decreasing  order  of  delay  sensitivity.  That  is,  traffic  type  1 
is  the  most  delay-sensitive,  followed  by  traffic  type  2,  and  so  on  with 
traffic  type  n  the  least  delay-sensitive.  Then  we  assign  the  highest 
(non-preemptive)  priority  to  traffic  type  1,  followed  by  traffic  type  2, 
etc.  The  reasons  for  practising  non-preemptive  priority  are  the  same  as 
those  advanced  in  chapter  I;  namely,  to  avoid  the  confusion  that  could 
arise  if  the  part  of  an  item  that  had  been  serviced  before  a  preemption 
occurs  is  interpreted  as  network  errors,  and  to  avoid  using  the  network 
resources  to  transmit  something  that  would  later  be  discarded.  Let 


the  expected  total  traffic  on  link(i,k)  of  traffic 
type  j,  j  =  l,...,n. 


+  F 


3 

ik 
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f|k  *  fik  "  fik  "  f?k 

n-1  . 

£ik 

j=l 


\  F.|^  =  ^  F:|l^  =  the  aggregate  traffic  on  link  Ci.k) 

,  j=l 

We  define  the  cost  functions  B'||^  and  CF^I^)  as  follows: 

®ik  ^^ik^  ”  congestion  cost  to  link  (i,k)  of  limiting 
the  traffic  from  traffic  types  1  through  j  to 
F^k  >  J  ’  1»2 . n-1. 

®ik  ^^ik^  *  congestion  cost  to  link  (i,k)  of  limiting 
the  aggregate  traffic  to  F^k* 

For  ease  of  analysis  we  assume  that  these  cost  functions  are  convex 
increasing  and  twice  differentiable  functions  of  their  respective  arguments. 
For  the  purpose  of  ensuring  that  the  network  is  not  heavily  loaded  with 

the  very  delay-sensitive  traffics,  we  require  that  B|k  cuts  off  earlier 

2  3 

than  B.jk»  which  in  turn  cuts  off  earlier  than  B^-k,  and  so  on  with  G-k 

cutting  off  the  last  but  before  the  link  capacity  C^k*  defining 

appropriate  rate  limitation  functions  as  we  did  in  Chapter  II,  we  ensure 

that  no  traffic  type  is  completely  excluded  from  using  the  network. 

For  the  purpose  of  illustrating  how  the  congestion  cost  functions  cut  off, 

we  present  typical  plots  of  these  functions  on  the  same  set  of  axes  in 

Figure  5.1.  In  the  plot,  traffic  types  1  and  2  are  the  very  delay- 


sensitive  types,  while  types  3  through  n  are  less  delay-sensitive. 


Figure  5.1  Congestion  Costs  of  Link  Traffics 


A  more  general  communication  network  application  of  this  genera¬ 
lized  model  than  the  type  we  consider  in  this  thesis  is  the  following. 
We  can  partition  all  communication  network  traffic  into  three  different 
classes  [9]: 

Class  I  :  characterized  by  long  messages  that  require  continuous 

real-time  delivery;  e.g.  voice  facsimile,  video. 

Class  II:  characterized  by  short  discrete  messages  that  require 

near  real-time  delivery;  e.g.  interactive  data. 

Class  III:  characterized  by  long  messages  that  require  neither 
continuity  nor  immediate  delivery;  e.g.  bulk  data. 

To  integrate  these  three  traffic  types  onto  one  network,  we  have 
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to  recognize  the  need  for  classes  I  and  II  traffics  to  suffer  less 
delay  than  class  III  traffic.  This  necessitates  assigning  the  highest 
(non-preemptive)  priority  to  class  I  traffic,  followed  by  class  II  traffic, 
and  class  III  traffic  is  the  low  priority  traffic.  Let 


Mk 

4 


4 

’^ik 


=  the  expected  total  class  I  traffic  on  link  0‘»k) 

the  expected  total  class  II  traffic  on  link  (i,k) 
the  expected  total  class  III  traffic  on  link  (i,k) 

+  f2 
Mk  Mk 

cl  a.  c2  X  c3 
^k  ^  ^-k  ^ 


Then  applying  our  argument  on  the  nature  of  the  congestion  cost  functions 
we  define  bJ^  and  G.,^  (F.,^)  as  shown  in  Figure  5.2- 
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APPENDIX  A 


In  this  appendix  we  give  the  proof  of  theorem  3.1  which  deals  with 
tne  necessary  and  sufficient  conditions  for  optimality  of  the  solution  co 
(2.13)  subject  to  (2.14)  through  (2.16).  We  prove  the  sufficiency  part 
of  the  theorem  here;  the  proof  of  the  necessity  part  of  the  theorem  is 
given  in  Appendix  B. 

Lemma  A.l  For  any  feasible  point  P*  =  {f^jj  (j),  which 

satisfies  the  conditions  of  theorem  3.1,  and  any  other  feasible  point 
P  =  {f^j^(j),  the  following  inequalities  hold: 


(i) 


L  [b;,(f^;)  .  g;,  (f;,)] 

i.j.k 


> 


yn,. . 
.  iJ 
1  ,J 


I  X 
ij  ij 


(11)  Lg;,,  (f;,^)  4(j) 

i  I J ,  k 


i  J 


"’ij  '"ij  '^ij 


with  equality  if  P 


* 

P 


Proof  From  (3.1)  we  have  that 
-v* 


“tk'fik'*  Sik<fik>"  i 


(*)  with  equality 


if  ^  Multiply  both  sides  of  (*)  by  f^|^(j)  and  sum  over  i,j,k: 

See;  (F?;)  -  g;^  (F;,):f;|,(3)  -  z  fik  (j)  ^  z  mi  flk«> 

i,j,k  i.j.k  i.j.k 
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with  equality  if  Thus 


X 

i )  j  j  k 


ik 


(flk)  +  s:,  (f;,)]  (j)  > 


'ik  ^’ik 


ik 


1  fj 


E 

i » j  >  k 


kj 


i.J 

^  ■  J.?  ^kj  ^  *^tk  fj' 

pi 

If 

[EfJl,(J)  -  E  fj;,  (j)3 

k  J. 

“  ^  ^ij 

8yn..  l.. 

i.J 

ij  1 J 

where  the  last  equality  follows  from  (2.14).  Similarly,  from  (3.2)  we  can 
show  that  inequality  (ii)  holds,  thus  completing  the  proof  of  the  lemma. 

Now  let  there  be  and  satisfying  (3.1)  through  (3.4)  at 
a  feasible  point  P*  =  '‘'ik*'*'  -  *ij'  '’ii'  '  P”*"* 

(flkU).  i'^l^(j).  and  a,  where  0  £  1,  define 

f^  (J)  •  (1  -  o)  f’k  (j)  +  O  f'k(j) 

f*  (J)  ■  (1  -  o)  fJ*  (j)  +  o 

(1  -  o)  t;^  +  at,j 

-  “>  "ij  *  “'•ij 

Then  J(a)  ■  E  C6,,(F™)  *  G,^(F^,)]  *  E  [rn,j  v,j  (t^j)  *  »,,j  E,j(n-j)] 


is  a  convex  function  of  a  .  Therefore, 


j(i) 


a  =  0 


S  [Bik  (F^;)  .  Glk  (F*,)]  [^CJl  - 


i  .j.k 


+  23  Yn,.  v!,U*^) 


1  .J 


ij  ij'-  ij  ij- 


♦  X.  Bik  (F*k)  [FjkO)  -  f?r  (j)] 


i  .j,k 


ik 


*  S  "'ij  ^Ij  C'-ij  ■  '•tj^ 

i  X  Xij  -  »*j]  *  Eb’'  "ij  Pij(<j)  Cl 

^  >  J  i  ,J 

*  X  Plj  "ij  [--Ij  -  --ijl  +  X  m,.  q,j(r*j)[r;j  - 

*  >J  *  >J 


X  By  n^j  [PjjilJj)  -  X,j]  -  Il,j] 

*  >J 

"’ij^^ij^’"ij^  ■  ^ij^  ^'"ij  ■  ’^ij^ 


i.j 


where  the  second  inequality  follows  from  lemma  A.l. 


OO).O(O) 

*-^ij  ■ 

I  J  I  j 


“ij  Coij  <'-*j)  -  «ij’  C'-'j  -  '•ij^ 


*  H 


*  ^:r*.=o  "'J 

^  J 


^  E 


S  *  _  d  '"ij  ^*^ij  ^'"ij^  ■  ^ij^  ^"'ij  "  ''ij^ 
"^ij 


Now  from  (3.1)  and  (3.2)  the  first  and  fourth  terms  are  zero.  All  other 
terms  are  greater  than  or  equal  to  zero.  Hence 


0(1)  -  0(0)  =  Op  -  Op*  ^0 

That  is,  0  at  any  feasible  point  P  is  greater  than  or  equal  to  0  at  P* 
This  completes  the  proof  of  sufficiency  of  (3.1)  through  (3.4). 
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APPENDIX  B 


In  this  appendix  we  give  the  proof  of  theorem  3.2,  which  deals  with 
the  convergence  properties  of  the  joint  flow  control  and  routing 
algorithm  H.  Recall  that  the  objective  function  J  is  given  by 

J  =  Z  (F“,)  *  Z  G,,  (F,,)  *  Sy-.,  V,  U,)  Y  Z™,  E^(r^) 

i,k  i,k  a  a 

Define  the  vector  u  by  the  tuple  u  =  (t,  r,  ,  where  l  is 

the  vector  of  voice  packet  lengths,  r  is  the  vector  of  data  input  rates, 

f'^  is  the  vector  of  link  voice  traffics,  and  F^  is  the  vector  of  link 

data  traffics.  Let  u"^  denote  the  vector  u  at  iteration  n.  Assume 

the  algorithm  is  started  with  a  feasible  u°  such  that  J(u°)  <  , 

for  some  positive  Let  the  set  be  defined  as  follows: 

0  0 


Ug  =  {u|j(u)<y 


(B.l) 


Then  u^eUg  .  Define  A (9)  as  follws: 


A(0)  =  J(u®)  -  J(u") 


(B.2) 


where  u®  *  0u*^^^  +  (1  -9)u'^  ,  0  <  9  <  1.  Then  for  all 


u®  e  Uq,  a(0)  is  continuous  in  0,  and 


a(0)  =  0 

A(l)  =  J(u"''^)  -  J(u'’) 


(B.3) 

(B.4) 


The  Taylor  expansion  of  A{0)  about  zero  is 

A(e) 

-  eE  ^  c-r’ 

i 

-  ^ 

^  1 

i  j  '  J 

[“r’  - 

e' 

u=u  : 

0  <  0’  <  0 

Thus 

dA(9) 

d0 

s 

E  MlA  .  u; 

] 

0 

=0 

1  1 

s 

2  calk  *  «ik 

(F?,)]  [F“(-'>  ■ 

-  f'"’  1 
^•k  J 

i.k 

+ 

G*  1  r|:d(n+l) 

- 

i  ,k 

+ 

2  vn,  v;  [.fl  - 

61 

+ 

2^  e;  (rj)  [rr’  - 

61 

^"3 

Leirana  6.1 

Assume  that  u'^eU^.  Then 

0. 

0=0 

Proof  From 

(3,25) 

and  (3.26) 

Ee 

vn  vn  r.vn 

ip  Ap  *  C<^p 

-  d''"(a)]  [Sj"  . 

5v(n+l)j 

PePa 

P^Py 

(since  e)^* 

=  0) 
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That  is. 


vn  .vn 
"p  ‘p 


Eip"  cs™  -  sj'"*')]  -  E[s™- 


*  Ed'"  [s'"  -  $'<"*'>]  -  d'l  [s'" 

p  ^  P  p  ^  P  D*’ 
P  V 


-  s'(""’>] 

Pw 


d^'^a) 


H  [sr- 


Now  d'^* 
P 

V 


=  d''"(a).  and  s''2  =  S^'^a) 


-  E 


«vn  ,vn  _ 
P  P 


-  s'"  ] 


But  d 


+  d'^^a)  CS''('’^^^a)  -  S""{a)] 
=  Ss^li.k)  [B.|^  (F^IJ)  +  G^.j^  (’^ik)3 


Therefore, 

E  E  e-  d-  =  -Ecs:,(r'".)*=i.<f;):E 

a  pcPj^  i  ,k  a  pcP^ 

*Ed'"(a)  [s'‘"*'>(a)  -  S'"U)] 


--EcBifc  (Fir)  ^s;,^  (F?^)l  [F?("*’>  -  F'p 


BY  Ed.  d'"(a)  uf’  - 


V*<s^ 
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where  the  last  equality  follows  from  (3.15)  and  the  definition  of  s'^'^(a). 
From  (3.21) 


d''"(a)  =  Zj  +  PgUj) 


a  peP, 


i  ,k 


♦  6y  S-'a  "a  <*2>  CC'  ■  *al 


-  6T  En,  Zj  [z;  -  C’] 


.  -  E  CBi,(r-)  .  b;,  (F?,)]  CF^’'  - 


i.k 


ik* 


:v  n,  v; 


-  6  YE"a  -  ^r'  ] 


(B.5) 


where  the  last  equality  follows  from  the  definition  of  see  (3.9) 

Now  from  (3.22),  [aJ  -  |  <  nj^lz"!-  Moreover,  when  zj  >  0, 

a"  -  a""^^  >  0;  and  when  z"  <0,  a"  -  a""^^  <  0.  Thus 

ad—  a—  da  — 


ZaX-<*’)  MZ,"l  IZa"-C’li"^' 


Therefore,  SY^  n,  zj  [zj  -  nj*’]  i8Y  rj'  E^CzJ 


and  -  svl^n,  zj  [zj  -  tj]  <  -  6Y  n't’  D  Cz^  -  Za"*'^^  " 


.n  „n+K2 
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Thus  from  (B.5) 


a  peP,  i.k 


^^k^  "■  ^-k  ^•k-' 


-  L 


^ v;  Hi)  [  r'  -  ‘j] 


-  8  Y  n"’  Cjf’  -  ilf 


(B.6) 


Also  from  (3.26)  Ap'^<_  .  Thus  Ap'^ 


Therefore,  from  (B.6)  we  have  that 


''■,’Z  z  ^ 

a  pcP.  1 » k 


v{n+l) 

ik 


pvn-i 

Mk-* 


Y  n,  v;  Hi)  CC'  -  <3 


-  8  Y  n-’  2  [tf’  -  l-lf 


(B.6a) 


Or 


E  [b! 


i  ,k 


ik  ^'ik'  ^  '^ik  'Mk'-*  '■"ik 


CF*'""')  -  f"].E 


.  ^vn,  v;  (.J) 

a 


<  -  0  Yn 


•’  En,  [«?*' 


I  a 


a  ‘-  a 


-0'-n:'E  Ecb!"]' 


a  peP^ 


Similarly,  it  can  be  shown  that 


^  (Fjk)  E:(r:)  [rr'  -  r;  ] 


i.k 


ik-*  ^  "a  “a'' a'  ‘■  a 

a 


t-n’l  E  "a  Irf  -  r",]  -  "d'  ^  g  Uj"]' 

d 


Therefore, 


dA(6) 


de 


1  -  n-'avE  n,  [zf  ’  -  2 


0=  0 


-  %E  E  tO^  -  "d'S  E. 


'  r  srp,  " 


a  peP. 


-  n 


E”a  ^ 


(B.7) 


1  0 

This  completes  the  proof  of  leima  B.l. 
Lemma  B.2.  Assume  u”  eU^.  Then 


<  0 


9=0 


if  u  is  not  an  optimal  point. 


Proof  From  the  result  of  lemma  B.l  we  have  that 


<  0.  To 


9=0 


show  that  the  inequality  is  strict  it  suffices  to  show  that  if  u"  is  not 


an  optimal  point  then  at  least  one  of  the  sums  in  (B.7)  is  strictly 
positive.  Assume  that  none  of  the  four  sums  in  (B.7)  is  strictly  positive. 
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Then  for  voice  we  have  the  following  situation: 

(i)  •  If  0<A2<a..  ,  then  this  situation  implies  that 

a  -  a  a  ij 

z”  =  d'''^(a)  -  p,(jl")  =  0,  and  the  marginal  gain  in  voice  quality 

Gi  a  a 

is  equal  to  the  marginal  voice  cost  of  congestion.  If  Jl”  =  0, 

ol 

then  Z"  >0  and  d''"(a)  >  And  if  Ji"  =  a..,  then  zj<0 

a  a  a  a  Ij  a 

and  d^"<p^(Ji;). 

(ii)  =  0,  which  means  that  =  0  since  by  assumption  s'f'^>0. 

P  P  P 

That  is,  =  d^*^  -  0,  and  all  voice  traffic  flows  on 

shortest  paths. 

By  a  similar  argument  for  data  we  have  that 

!=  d^"(a)  if  0  <  r"  <  r^ 

>d^"(a) 

<  d‘^'’(a)  if  r J  =  0 

(iv)  All  data  traffic  flows  on  shortest  paths. 

But  results  (i)  through  (iv)  are  precisely  the  Kuhn-Tucker  conditions 
for  optimality  given  in  (3.1)  through  (3.4).  Thus  by  the  sufficiency 
part  of  theorem  3.1,  proved  in  Appendix  A,  u"^  is  an  optimal  point. 
Therefore,  if  u”  is  not  an  optimal  point  at  least  one  sum  in  (B.7)  must 
be  strictly  positive,  thus  proving  the  lemma. 

The  implication  of  lemma  B.2  is  that  for  small  enough  0,  A(e)<  0. 
Since  a(0)  is  continuous  in  9  for  u  eU^,  either  A(e)  <  0  for  all 


1 


6  ^  1  or  there  exists  a  e^<  1  such  that  /^(e)  <  0  for  e  <  e-j  and 
a(Q-^)  -  0.  That  is,  the  plot  of  ^(e)  takes  the  form  of  either  curve  (i) 
or  curve  (ii)  of  Fig.  B.l.  Let  be  the  smallest  e,  0  <  3  ^1 .  for 
which  a(0)  =  0.  If  no  such  e  exists,  then  let  a(0,)  =  a(1)- 


Figure  B.l  Possible  Forms  of  A(0) 


Assume  that  there  exists  e-j  <  such  thatA  Co-j )  =  0.  The  Taylor 
expansion  of  a(0i)  (about  zero)  is 
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From  lemma  B.l 


a'Ku")  r,n+l 

8u. 


dA(9) 

de 


e 


=  0 


0  <  e-| 


0 
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The  last  equality  follows  from  the  fact  that  we  are  taking  partial  and 
not  total  derivatives.  By  the  same  argument  we  have  that  all  terms 


2  2 
|  ■  .  in  which  ^  “j*  except  that  ^  0-  Thus 

i  j 


^  .  u"]  [u')'"^  -  U*)]! 


fl' 

[1  =  ur 


(ffk  ”  tflk"""  - 

i.k 


^  E  =;'k  (<k> 


-  2  E  (il)  -  F?I]  . 


ik-*  '■  ik 


+  E  ’f  "a  (k®)  [kj*’  - 

a  ' 


"  E  "a  <  (f|'  )  tFf'  -  r"]2 


(B.8) 


SinceA  (0)  is  continuous  in  9  for  u^eU^,  the  second  derivatives  exist 
over  the  compact  region  0  _<  0  £  9^. 


Lemma  B.3  Let  M  -  max  max 


u:J(u)<Jo 


V.UJ 


for  some  positive  Then 


E''a'';(k®')  i  E"a[C’ 


Proof  Recall  that  =  {u|J(u)  ^  JqJ  for  some  positive  Since 
we  assume  u® e  U.  for  0c[O,l],  then  )  <  M..  The  proof  of  the 
lemma  follows  then  from  the  assumption  of  the  lemma. 


Lemma  B.4.  Let  M..  =  max  max 
-  r 


Then 


Ell  (r,)  for  some  positive  J  . 
a  u:J{u)<Jq  ^  ®  o 


Proof  Similar  to  the  proof  of  lenma  B.3. 


Lenina, B. 5  Let  M  =  max  max  [bJ.  (fV.)  +  g"  (F..)] 

''  i.k  u:J(u)<J^ 

for  some  Furthermore,  let  the  cardinalities  of  the  sets  and 
be  lAyl  and  iP^l  ,  respectively.  Then 


''  ''  ®  a  pcP,  P 


Proof  For  the  same  reason  given  in  the  proof  of  lemma  B.3,  we  have 

I  I 

thn  )  *  g;,  (F®,)  <  Thus 

5  (<)  *  [fir*  - 


From  (3.15)  we  have 

rpv{n+l)  _  pVn-,2  _ 
‘•^•k  ^’k-* 


that 

[Z  Z  G,  (I.W  -  s-of 

a  pcPg  H  H 

|AJ  |P,|  Z  Z  !p(f.k) 

d 


< 
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where  the  inequality  is  the  Cauchy-Schwarz  inequality.  Since  we  make 
incremental  changes  at  each  iteration,  the  largest  change  in  any  path 
flow  cannot  exceed  the  sum  of  all  changes  in  path  flows  for  the  same 
source  -  destination  pair.  Therefore, 


|3v(n*1)  .  jvn,  ^ 

[sv(n-l)  ''P' 

iiPai  r, 

pePg 

where  the  last  inequality  is  the  Cauchy-Schwarz  inequality.  Therefore, 


<  |AJ^  iPal^  Y,  13 


a  peP, 


That  is,  <  IaJ2  |pj3  ^  S  5  (i  .k)  [A^"]2 


a  peP, 


And 


E  -  f™:2<n2  ip,|3  E  E  up2 


i  .k 


a  peP. 


Multiplying  both  sides  by  M^  completes  the  proof  of  the  lenuia. 


Lemma  8.6  Let  M.  *  max  max  G..  (F.. ) 

i,k  u:J(u)<J 
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for  some  Furthermore  let  1  P,  |  be  as  defined  in  lemma  B.5,  and  let 

0  a 


1 A^l  be  the  cardinality  of  the  set  A^.  Then 


E  (<k)  i-'di'  1^1’  E  T. 

i,k  a  peP, 


Proof  The  proof  is  similar  to  the  proof  of  lemma  B.5. 


Lemma  B.7  Let  and  |A^1  be  as  defined  in  lemma  B.6,  and  let 


[A,landlP,|  be  as  defined  in  lemma  B.5, 

V  d 


Then 


i,k 


<'k  (^'k  -  f-] 


ik^ 


i  E  Y, 

a  peP, 


a  peP, 


Proof  We  know  that  (x^.  -  y^)^  =  ^  ^  (x^  +  y?  -  2x^  y^)  ^  0 

i  i 

^xiy.  "S>i 


Thus 


i  1  1 

Now  from  the  assumptions  of  the  lemma, 

E  <k  (nV  -  Cki 


i.k 


i  H,  E  CFji"*"  -  F-]  [Ft(-"  -  F?J] 


ti 


ik> 


I 
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If  we  let  ^ 


pvn 


and 


'i  'ik 


-  F' 


dn 

ik 


then  from  (B.9)  we  obtain 


i  ,k 


<  i-  M  rFv(n+l)  .  Fvn-,2 

1  J  ^  1-1-^,^ 


-F?5]2 

I  I K 

17  "d"^  iM^  im’  X)  12  [A™]^ 

a  PePa 
[''dl^  l'’al^  ^ 

where  the  last  inequality  follows  from  lemmas  B.5  and  B.6. 

From  the  results  of  lemma  B.l,  and  lemmas  B.3  through  B.7  we 
obtain 

A(e,)  i-Mj)  lA,!^  IP,!^-  r,;']  r  E  ur-f 

a  peP. 


*  9,[6,  MjN‘  lAj|‘  |P,r-dd 


-  JiE  E 


dnnZ 


[A^'] 


a  peP^ 
.n+1  .n,2 


*  -aJ] 

a 

+  0T  ij  01  -  n;^]  53ma  [rj'"^  +  r"]^ 


Lemma  B.8  Let  the  scale  factors  be  chosen  as  follows; 


n,  =  Cj  (N,  t  Mj)  |A,1^  iPjl^]"' 

Hd  ■  [Md  I'^dl^ 

=  6  y[j  Mj] 

'  Cj  ”r^'' 

Then  if  is  not  an  optimal  point,  A(6^)  <  0. 

Proof  Substituting  the  n's,  as  defined  in  the  lemma,  in  (B.IO)  we 
obtain 

+  n2  lAj2  lPj3[e^-i]]2 

a  pcPg 

+  9^  lA^l^  IP  [Q  -  1]  23  S 

‘  ^  ®  '  a  peP,  P 

a 

Y  I  9,  M,  ce,  -  I]  n, 

a 

Y  I-  e,  H^ce,  -  VjZ",  ['•r  -  --^3' 

a 

Since  we  assume  Q-j  <_  1,  we  have  that  A(e^)  <_0.To  show  that  A(9i)  <  0 

I 

if  the  n  s  are  selected  as  stated  in  the  lemma,  it  suffices  to  show 
that  at  least  one  of  the  sums  above  is  strictly  nonzero  if  u'^  is  not 
an  optimal  point.  But  this  is  what  we  proved  in  lemma  B.l.  Thus  the 
proof  of  the  lemma  is  completed. 


I* 
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The  result  of  this  lemma  shows  that  there  exists  a  choice  of 
scale  factors  such  that  A(0^)<  0.  Therefore,  with  the  scale  factors 
chosen  as  in  lemma  B.8,  the  assumption  that  A(6^)  =  0  for  9-|  <  1 
is  contradicted.  Thus  if  u”  is  not  an  optimal  point  and  the  scale 
factors  are  chosen  as  in  lemma  B.8,  A(e^)  <  0  for  0  <  9^  ^  1. 

And  in  particular,  a(1)  <  0.  That  is,  J(n'’'^b  -  J(u^)  <  0.  By 
induction,  J(u'^)  <  JCn"^  b  <  •  •  •  <  J(u°).  But  we  started  with  a 
feasible  u*^  such  that  J(u®)  <  J^.  Therefore  J(u'^)  <  0^.  Thus  the 
algorithm  is  a  descent  algorithm;  and  if  u°  cU^,  the  u^  eU^  for 
all  n  ^  1 . 

Leimia  B.9  The  mapping  H  is  closed. 

Proof  We  define  closedness  of  a  point- to-set  mapping  in  the  same 
way  it  is  defined  by  Luenberger  [25].  That  is,  let  H  be  a  point- to- 
set  mapping  which  maps  points  in  a  space  X  into  subsets  of  another 
space  Y.  Then  H  is  said  to  be  closed  at  x  cX  if  the  assumptions  that 

(i)  {x^}  -►  X  ,  for  x"  e  X 

(ii)  {y"}  ^  y  .  for  y"  e  H(x") 

imply  that  y  cH(x). 

Let  {w”}  *  {Sp"  ,  sj'’  ,  s,g  ,  rj}  be  a  sequence 

which  converges  to  w  =  (Sp,  Sp,  tg,  r^).  Then 

^  jvn 
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Si  nee  fJU 


and  since  Sp^  -►  if  we  started  with 

u®  eUq  (since  by  the  previous  result  all  subsequent  u''  are  also 


vn 

P 

vn 


elements  of  Uq). 


Thus  d 


vn 


2  (frk> "  c  “ 

(i.k)ep 


B..  and  G..  are  continuous  in  fV"  And 


ik 


ik 


ik- 


since 


d'"’(a)  =  Min  d''"  -^d''(a) 

PEP,  f 


.vn  ,  ^vn  . 


-p  -p  ^  -P  • 

Therefore,  =  min  [Sp"  ,  ep">  aJ 


Let  the  sequence  {  w  }  =  {  s)'”  ,  Jl  [J,  r" }  be  another 

n  p  p  a  a 

sequence  that  converges  to  w  =  (s)[,  S^,  ^  ,  r).  Furthermore,  let 

P  P  a  o 

VSf. 

the  sequences  {w^}  and  (w"}  be  related  as  follows: 


Sp-  S 


if  P 


:vn 


S'^a) 


P^P 


,>vn  .vnx  -r  «  *n 
(Sp  -  Ap  )  if  p  »  p^ 


where  p^  is  an  optimal  voice  path  at  iteration  n. 


'dn 


^dn  ,  dn 
■  ‘'p 


tf  P  /  pj" 
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where  is  an  optinal  data  path  at  iteration  n. 


7" 


0  <ll  -  n,  Z"  <  a. . 


‘ij 


if  t"  - 
d 


\  z”  >  a. . 
'jl  a  -  ij 


if  t 


n  z”  <  0 
I  a  — 


_  I 

‘  I 

where  z[*  and  are  as  previously  defined.  Note  that  z”  and  converge 

da  ad 

to  Z,  and  x,,  respectively,  since  these  terms  (i.e.  z”  and  x^)  are 

da  d  d 

continuous  in  w*^. 

Now  we  have  that  Sp'’  -  converges  to  Sp  -  Ap  for  all  p  and, 

^vn  V  V 

by  assumption,  Sp  converges  to  Sp  for  all  p.  Suppose  Sp  Sp  -  Ap 

for  some  p.  Then  there  exists  some  e  >  0  such  that  |Sp  -  (Sp  -  Ap)!=  e. 

Also  there  exists  some  n^  such  that  for  n  ^  n^  and  p  p^  , 

ISp"-  (Sp"  -  aJ")1  <  e/2.  Thus  for  n  >  n^,  p  =  p*"  .  That  is. 


''a  "  ^  V  ^  0  ’’a  “  0  -  x"  <  r" 

did  d  r  a  d 


..  n  „  n  ^  d 
if  r^  -  X.  >  r^ 
a  r  a  —  a 


if  r"  -  n..  x"  <  0 


-vn  ^  -V 
P  P 


s;  -  ifp/'p* 


SMa) 


(Sp  -  Ap)  if  p  -  p* 

pj*?! 
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•k 

where  is  some  limiting  optimal  path.  By  the  definition  of  closed¬ 
ness  [25],  we  conclude  that  H  is  closed  at  Sp  since  Sp  eH(Sp. 

By  a  similar  argument  we  also  conclude  that  H  is  closed  at  S^,  since 
Sp  eH(Sp.  Since  converges  to  -n^  for  all  a,  and 

since  by  assumption  converges  to  i,,  we  can  apply  the  above 

a  a 

argument  to  conclude  that 


^a  ■  ^a 


I  ->■  I  =  /  a . . 
a  "“a  S  “ij 


If  0  <  1,  -  z,  < 
‘a  -  i 


*a  ■  ’’A  i  ° 


Thus  H  is  closed  at  A.  since  A,  cH(A,).  And  by  a  similar  argument 

a  d  d 

A 

we  conclude  that  H  is  also  closed  at  r.,  since  r^  £H(r,).  Thus 

o  d  d 

A 

H  is  closed  at  w  since  w  eH(w),  and  this  completes  the  proof  of 
the  lemma. 


Proof  of  Theorem  3.2  Let  U  be  the  following  compact  set: 

(J  =  {ulJ(u)  ^  Og.  u  is  a  feasible  point  of  (2.14)  through  (2.16)} 

Then  H  is  a  closed  point- to-set  mapping  of  points  in  U  into  sets  of 
points  in  U.  Also  by  lemma  B.8,  the  sequence  {J(u'^)}  is  a  strictly 
decreasing  sequence.  That  is,  if  u”  is  not  an  optimal  point  then 
J(n”  <  J(u”),  where  u"^^  eH(u'^).  Therefore,  by  the  global  convergence 
theorem  [25,  p.  125],  the  limit  of  any  convergent  subsequence  of  the 
sequence  {u^}  generated  by  H  is  a  solution  to  (2.13).  This  completes 


the  proof  of  theorem  3.2. 


Proof  of  Necessity  of  Theorem  3.1 


From  lemma  B.8,  we  observe  that  0  strictly  decreases  if 
equations  (3.1)  through  (3.4)  are  not  satisfied.  Thus  at  any  point  u 
that  these  equations  are  not  satisfied  the  algorithm  produces  a  better 
point,  which  means  that  u  cannot  be  an  optimal  point.  This  then 
proves  the  necessity  part  of  theorem  3.1. 
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